Apr 23 03:39:53 user devstack@n-api.service[61305]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Apr 23 03:39:53 user devstack@n-api.service[61305]: *** Starting uWSGI 2.0.20-debian (64bit) on [Sun Apr 23 03:39:53 2023] *** Apr 23 03:39:53 user devstack@n-api.service[61305]: compiled with version: 11.2.0 on 21 March 2022 11:00:44 Apr 23 03:39:53 user devstack@n-api.service[61305]: os: Linux-5.15.0-67-generic #74-Ubuntu SMP Wed Feb 22 14:14:39 UTC 2023 Apr 23 03:39:53 user devstack@n-api.service[61305]: nodename: user Apr 23 03:39:53 user devstack@n-api.service[61305]: machine: x86_64 Apr 23 03:39:53 user devstack@n-api.service[61305]: clock source: unix Apr 23 03:39:53 user devstack@n-api.service[61305]: pcre jit disabled Apr 23 03:39:53 user devstack@n-api.service[61305]: detected number of CPU cores: 12 Apr 23 03:39:53 user devstack@n-api.service[61305]: current working directory: / Apr 23 03:39:53 user devstack@n-api.service[61305]: detected binary path: /usr/bin/uwsgi-core Apr 23 03:39:53 user devstack@n-api.service[61305]: your processes number limit is 63638 Apr 23 03:39:53 user devstack@n-api.service[61305]: your memory page size is 4096 bytes Apr 23 03:39:53 user devstack@n-api.service[61305]: detected max file descriptor number: 2048 Apr 23 03:39:53 user devstack@n-api.service[61305]: lock engine: pthread robust mutexes Apr 23 03:39:53 user devstack@n-api.service[61305]: thunder lock: enabled Apr 23 03:39:53 user devstack@n-api.service[61305]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Apr 23 03:39:53 user devstack@n-api.service[61305]: Python version: 3.10.6 (main, Mar 10 2023, 10:55:28) [GCC 11.3.0] Apr 23 03:39:53 user devstack@n-api.service[61305]: Python main interpreter initialized at 0x555902f16990 Apr 23 03:39:53 user devstack@n-api.service[61305]: python threads support enabled Apr 23 03:39:53 user devstack@n-api.service[61305]: your server socket listen backlog is limited to 100 connections Apr 23 03:39:53 user devstack@n-api.service[61305]: your mercy for graceful operations on workers is 90 seconds Apr 23 03:39:53 user devstack@n-api.service[61305]: mapped 537436 bytes (524 KB) for 3 cores Apr 23 03:39:53 user devstack@n-api.service[61305]: *** Operational MODE: preforking *** Apr 23 03:39:53 user devstack@n-api.service[61305]: *** uWSGI is running in multiple interpreter mode *** Apr 23 03:39:53 user devstack@n-api.service[61305]: spawned uWSGI master process (pid: 61305) Apr 23 03:39:53 user devstack@n-api.service[61305]: spawned uWSGI worker 1 (pid: 61306, cores: 1) Apr 23 03:39:53 user devstack@n-api.service[61305]: spawned uWSGI worker 2 (pid: 61307, cores: 1) Apr 23 03:39:53 user devstack@n-api.service[61305]: spawned uWSGI worker 3 (pid: 61308, cores: 1) Apr 23 03:39:53 user devstack@n-api.service[61305]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Apr 23 03:39:53 user devstack@n-api.service[61308]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 23 03:39:53 user devstack@n-api.service[61306]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 23 03:39:53 user devstack@n-api.service[61307]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 23 03:39:56 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} Apr 23 03:39:56 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} Apr 23 03:39:56 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} Apr 23 03:39:56 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} Apr 23 03:39:56 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} Apr 23 03:39:56 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:56 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:56 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:56 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:56 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:56 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:56 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:56 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:56 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:56 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:56 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:56 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:56 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:56 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:56 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:56 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:56 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:56 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:56 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:56 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:56 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:56 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:56 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:56 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:56 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:56 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:56 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:56 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:56 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:56 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:56 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:56 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:56 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:56 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:56 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} Apr 23 03:39:56 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:56 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} Apr 23 03:39:56 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:56 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} Apr 23 03:39:56 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:56 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:56 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} Apr 23 03:39:56 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} Apr 23 03:39:56 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:56 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:56 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:56 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:56 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:56 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:56 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:56 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:56 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:56 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:56 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:56 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:56 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:56 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:56 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:56 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:56 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:56 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:56 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:56 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:56 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:56 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:56 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:56 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:56 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:56 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:56 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:56 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:56 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:56 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:56 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:56 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:56 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:56 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:56 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Apr 23 03:39:57 user devstack@n-api.service[61308]: live_migration_uri is deprecated for removal in favor of two other options that Apr 23 03:39:57 user devstack@n-api.service[61308]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Apr 23 03:39:57 user devstack@n-api.service[61308]: and ``live_migration_inbound_addr`` respectively. Apr 23 03:39:57 user devstack@n-api.service[61308]: ). Its value may be silently ignored in the future. Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Apr 23 03:39:57 user devstack@n-api.service[61307]: live_migration_uri is deprecated for removal in favor of two other options that Apr 23 03:39:57 user devstack@n-api.service[61307]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Apr 23 03:39:57 user devstack@n-api.service[61307]: and ``live_migration_inbound_addr`` respectively. Apr 23 03:39:57 user devstack@n-api.service[61307]: ). Its value may be silently ignored in the future. Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Apr 23 03:39:57 user devstack@n-api.service[61306]: live_migration_uri is deprecated for removal in favor of two other options that Apr 23 03:39:57 user devstack@n-api.service[61306]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Apr 23 03:39:57 user devstack@n-api.service[61306]: and ``live_migration_inbound_addr`` respectively. Apr 23 03:39:57 user devstack@n-api.service[61306]: ). Its value may be silently ignored in the future. Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61307) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61306) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} Apr 23 03:39:57 user devstack@n-api.service[61308]: INFO dbcounter [None req-2e7c8a5c-8390-4fdb-9ab1-aeed67f36611 None None] Registered counter for database nova_api Apr 23 03:39:57 user devstack@n-api.service[61307]: INFO dbcounter [None req-1d18a248-24ba-45d4-867d-54881c169a6e None None] Registered counter for database nova_api Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG oslo_db.sqlalchemy.engines [None req-2e7c8a5c-8390-4fdb-9ab1-aeed67f36611 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61308) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG oslo_db.sqlalchemy.engines [None req-1d18a248-24ba-45d4-867d-54881c169a6e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61307) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG dbcounter [-] [61307] Writer thread running {{(pid=61307) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG dbcounter [-] [61308] Writer thread running {{(pid=61308) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 23 03:39:57 user devstack@n-api.service[61306]: INFO dbcounter [None req-be3866cb-bdc8-4797-ae28-44d5139cdce6 None None] Registered counter for database nova_api Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG nova.context [None req-1d18a248-24ba-45d4-867d-54881c169a6e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb(cell1) {{(pid=61307) load_cells /opt/stack/nova/nova/context.py:464}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG nova.context [None req-2e7c8a5c-8390-4fdb-9ab1-aeed67f36611 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb(cell1) {{(pid=61308) load_cells /opt/stack/nova/nova/context.py:464}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-1d18a248-24ba-45d4-867d-54881c169a6e None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-1d18a248-24ba-45d4-867d-54881c169a6e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-2e7c8a5c-8390-4fdb-9ab1-aeed67f36611 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-2e7c8a5c-8390-4fdb-9ab1-aeed67f36611 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-1d18a248-24ba-45d4-867d-54881c169a6e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-1d18a248-24ba-45d4-867d-54881c169a6e None None] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-1d18a248-24ba-45d4-867d-54881c169a6e None None] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-2e7c8a5c-8390-4fdb-9ab1-aeed67f36611 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-2e7c8a5c-8390-4fdb-9ab1-aeed67f36611 None None] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-2e7c8a5c-8390-4fdb-9ab1-aeed67f36611 None None] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-1d18a248-24ba-45d4-867d-54881c169a6e None None] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG oslo_db.sqlalchemy.engines [None req-be3866cb-bdc8-4797-ae28-44d5139cdce6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61306) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-2e7c8a5c-8390-4fdb-9ab1-aeed67f36611 None None] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:39:57 user devstack@n-api.service[61307]: INFO dbcounter [None req-1d18a248-24ba-45d4-867d-54881c169a6e None None] Registered counter for database nova_cell0 Apr 23 03:39:57 user devstack@n-api.service[61308]: INFO dbcounter [None req-2e7c8a5c-8390-4fdb-9ab1-aeed67f36611 None None] Registered counter for database nova_cell0 Apr 23 03:39:57 user devstack@n-api.service[61307]: INFO dbcounter [None req-1d18a248-24ba-45d4-867d-54881c169a6e None None] Registered counter for database nova_cell1 Apr 23 03:39:57 user devstack@n-api.service[61308]: INFO dbcounter [None req-2e7c8a5c-8390-4fdb-9ab1-aeed67f36611 None None] Registered counter for database nova_cell1 Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG dbcounter [-] [61306] Writer thread running {{(pid=61306) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG oslo_db.sqlalchemy.engines [None req-1d18a248-24ba-45d4-867d-54881c169a6e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61307) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG dbcounter [-] [61307] Writer thread running {{(pid=61307) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG oslo_db.sqlalchemy.engines [None req-1d18a248-24ba-45d4-867d-54881c169a6e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61307) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG oslo_db.sqlalchemy.engines [None req-2e7c8a5c-8390-4fdb-9ab1-aeed67f36611 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61308) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG oslo_db.sqlalchemy.engines [None req-2e7c8a5c-8390-4fdb-9ab1-aeed67f36611 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61308) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG dbcounter [-] [61308] Writer thread running {{(pid=61308) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG nova.context [None req-be3866cb-bdc8-4797-ae28-44d5139cdce6 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb(cell1) {{(pid=61306) load_cells /opt/stack/nova/nova/context.py:464}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-be3866cb-bdc8-4797-ae28-44d5139cdce6 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-be3866cb-bdc8-4797-ae28-44d5139cdce6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-be3866cb-bdc8-4797-ae28-44d5139cdce6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-be3866cb-bdc8-4797-ae28-44d5139cdce6 None None] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-be3866cb-bdc8-4797-ae28-44d5139cdce6 None None] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-be3866cb-bdc8-4797-ae28-44d5139cdce6 None None] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:39:57 user devstack@n-api.service[61306]: INFO dbcounter [None req-be3866cb-bdc8-4797-ae28-44d5139cdce6 None None] Registered counter for database nova_cell0 Apr 23 03:39:57 user devstack@n-api.service[61306]: INFO dbcounter [None req-be3866cb-bdc8-4797-ae28-44d5139cdce6 None None] Registered counter for database nova_cell1 Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG oslo_db.sqlalchemy.engines [None req-be3866cb-bdc8-4797-ae28-44d5139cdce6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61306) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG oslo_db.sqlalchemy.engines [None req-be3866cb-bdc8-4797-ae28-44d5139cdce6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61306) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG dbcounter [-] [61306] Writer thread running {{(pid=61306) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG dbcounter [-] [61307] Writer thread running {{(pid=61307) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 23 03:39:57 user devstack@n-api.service[61307]: INFO dbcounter [None req-1d18a248-24ba-45d4-867d-54881c169a6e None None] Registered counter for database nova_cell0 Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG oslo_db.sqlalchemy.engines [None req-1d18a248-24ba-45d4-867d-54881c169a6e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61307) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 23 03:39:57 user devstack@n-api.service[61307]: DEBUG dbcounter [-] [61307] Writer thread running {{(pid=61307) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG dbcounter [-] [61308] Writer thread running {{(pid=61308) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 23 03:39:57 user devstack@n-api.service[61308]: INFO dbcounter [None req-2e7c8a5c-8390-4fdb-9ab1-aeed67f36611 None None] Registered counter for database nova_cell0 Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG oslo_db.sqlalchemy.engines [None req-2e7c8a5c-8390-4fdb-9ab1-aeed67f36611 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61308) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 23 03:39:57 user devstack@n-api.service[61308]: DEBUG dbcounter [-] [61308] Writer thread running {{(pid=61308) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG dbcounter [-] [61306] Writer thread running {{(pid=61306) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 23 03:39:57 user devstack@n-api.service[61306]: INFO dbcounter [None req-be3866cb-bdc8-4797-ae28-44d5139cdce6 None None] Registered counter for database nova_cell0 Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG oslo_db.sqlalchemy.engines [None req-be3866cb-bdc8-4797-ae28-44d5139cdce6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61306) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 23 03:39:57 user devstack@n-api.service[61306]: DEBUG dbcounter [-] [61306] Writer thread running {{(pid=61306) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 23 03:39:57 user devstack@n-api.service[61307]: WARNING keystonemiddleware.auth_token [None req-1d18a248-24ba-45d4-867d-54881c169a6e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 23 03:39:57 user devstack@n-api.service[61307]: WARNING keystonemiddleware.auth_token [None req-1d18a248-24ba-45d4-867d-54881c169a6e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 23 03:39:57 user devstack@n-api.service[61306]: WARNING keystonemiddleware.auth_token [None req-be3866cb-bdc8-4797-ae28-44d5139cdce6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 23 03:39:57 user devstack@n-api.service[61308]: WARNING keystonemiddleware.auth_token [None req-2e7c8a5c-8390-4fdb-9ab1-aeed67f36611 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 23 03:39:57 user devstack@n-api.service[61308]: WARNING keystonemiddleware.auth_token [None req-2e7c8a5c-8390-4fdb-9ab1-aeed67f36611 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 23 03:39:57 user devstack@n-api.service[61306]: WARNING keystonemiddleware.auth_token [None req-be3866cb-bdc8-4797-ae28-44d5139cdce6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 23 03:39:58 user devstack@n-api.service[61307]: WARNING keystonemiddleware.auth_token [None req-1d18a248-24ba-45d4-867d-54881c169a6e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 23 03:39:58 user devstack@n-api.service[61307]: WARNING keystonemiddleware.auth_token [None req-1d18a248-24ba-45d4-867d-54881c169a6e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 23 03:39:58 user devstack@n-api.service[61307]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x555902f16990 pid: 61307 (default app) Apr 23 03:39:58 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi [None req-1d18a248-24ba-45d4-867d-54881c169a6e None None] Calling method '>' {{(pid=61307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 03:39:58 user devstack@n-api.service[61307]: INFO nova.api.openstack.requestlog [None req-1d18a248-24ba-45d4-867d-54881c169a6e None None] 10.0.0.210 "GET /compute/v2.1/" status: 200 len: 387 microversion: 2.1 time: 0.001611 Apr 23 03:39:58 user devstack@n-api.service[61307]: [pid: 61307|app: 0|req: 1/1] 10.0.0.210 () {50 vars in 783 bytes} [Sun Apr 23 03:39:58 2023] GET /compute/v2.1/ => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 23 03:39:58 user devstack@n-api.service[61308]: WARNING keystonemiddleware.auth_token [None req-2e7c8a5c-8390-4fdb-9ab1-aeed67f36611 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 23 03:39:58 user devstack@n-api.service[61308]: WARNING keystonemiddleware.auth_token [None req-2e7c8a5c-8390-4fdb-9ab1-aeed67f36611 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 23 03:39:58 user devstack@n-api.service[61308]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x555902f16990 pid: 61308 (default app) Apr 23 03:39:58 user devstack@n-api.service[61306]: WARNING keystonemiddleware.auth_token [None req-be3866cb-bdc8-4797-ae28-44d5139cdce6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 23 03:39:58 user devstack@n-api.service[61306]: WARNING keystonemiddleware.auth_token [None req-be3866cb-bdc8-4797-ae28-44d5139cdce6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 23 03:39:58 user devstack@n-api.service[61306]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x555902f16990 pid: 61306 (default app) Apr 23 03:42:05 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi [None req-1d18a248-24ba-45d4-867d-54881c169a6e None None] Calling method '>' {{(pid=61307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 03:42:05 user devstack@n-api.service[61307]: INFO nova.api.openstack.requestlog [None req-1d18a248-24ba-45d4-867d-54881c169a6e None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001760 Apr 23 03:42:05 user devstack@n-api.service[61307]: [pid: 61307|app: 0|req: 2/2] 10.0.0.210 () {54 vars in 924 bytes} [Sun Apr 23 03:42:05 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 23 03:42:05 user devstack@n-api.service[61308]: DEBUG dbcounter [-] [61308] Writing DB stats nova_api:SELECT=3 {{(pid=61308) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:42:05 user devstack@n-api.service[61308]: DEBUG dbcounter [-] [61308] Writing DB stats nova_cell0:SELECT=3 {{(pid=61308) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:42:05 user devstack@n-api.service[61308]: DEBUG dbcounter [-] [61308] Writing DB stats nova_cell1:SELECT=3 {{(pid=61308) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:42:05 user devstack@n-api.service[61308]: DEBUG dbcounter [-] [61308] Writing DB stats nova_cell0:SELECT=3 {{(pid=61308) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:42:05 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi [None req-089f83c0-59a3-4c4b-8bef-3820b4541067 admin admin] Calling method '>' {{(pid=61308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 03:42:05 user devstack@n-api.service[61308]: INFO nova.api.openstack.requestlog [None req-089f83c0-59a3-4c4b-8bef-3820b4541067 admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.364162 Apr 23 03:42:05 user devstack@n-api.service[61308]: [pid: 61308|app: 0|req: 1/3] 10.0.0.210 () {60 vars in 1285 bytes} [Sun Apr 23 03:42:05 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 23 03:42:07 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi [None req-be3866cb-bdc8-4797-ae28-44d5139cdce6 None None] Calling method '>' {{(pid=61306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 03:42:07 user devstack@n-api.service[61306]: INFO nova.api.openstack.requestlog [None req-be3866cb-bdc8-4797-ae28-44d5139cdce6 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002153 Apr 23 03:42:07 user devstack@n-api.service[61306]: [pid: 61306|app: 0|req: 1/4] 10.0.0.210 () {54 vars in 924 bytes} [Sun Apr 23 03:42:07 2023] GET /compute/v2.1 => generated 387 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 23 03:42:07 user devstack@n-api.service[61307]: DEBUG dbcounter [-] [61307] Writing DB stats nova_api:SELECT=3 {{(pid=61307) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:42:07 user devstack@n-api.service[61307]: DEBUG dbcounter [-] [61307] Writing DB stats nova_cell0:SELECT=3 {{(pid=61307) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:42:07 user devstack@n-api.service[61307]: DEBUG dbcounter [-] [61307] Writing DB stats nova_cell1:SELECT=3 {{(pid=61307) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:42:07 user devstack@n-api.service[61307]: DEBUG dbcounter [-] [61307] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=61307) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:42:08 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi [None req-d23f56c7-f7de-4abb-b45a-c270cb7def5b admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "rxtx_factor": 1.0, "name": "cirros256", "id": "c1", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "ram": 256, "swap": 0}} {{(pid=61307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 03:42:08 user devstack@n-api.service[61307]: INFO nova.api.openstack.requestlog [None req-d23f56c7-f7de-4abb-b45a-c270cb7def5b admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.322213 Apr 23 03:42:08 user devstack@n-api.service[61307]: [pid: 61307|app: 0|req: 3/5] 10.0.0.210 () {64 vars in 1276 bytes} [Sun Apr 23 03:42:07 2023] POST /compute/v2.1/flavors => generated 405 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 23 03:42:08 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi [None req-36d4c4aa-f0de-4157-ae96-3a4664db6acf admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 03:42:08 user devstack@n-api.service[61308]: INFO nova.api.openstack.requestlog [None req-36d4c4aa-f0de-4157-ae96-3a4664db6acf admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.047114 Apr 23 03:42:08 user devstack@n-api.service[61308]: [pid: 61308|app: 0|req: 2/6] 10.0.0.210 () {64 vars in 1329 bytes} [Sun Apr 23 03:42:08 2023] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 23 03:42:10 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi [None req-be3866cb-bdc8-4797-ae28-44d5139cdce6 None None] Calling method '>' {{(pid=61306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 03:42:10 user devstack@n-api.service[61306]: INFO nova.api.openstack.requestlog [None req-be3866cb-bdc8-4797-ae28-44d5139cdce6 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002344 Apr 23 03:42:10 user devstack@n-api.service[61306]: [pid: 61306|app: 0|req: 2/7] 10.0.0.210 () {54 vars in 924 bytes} [Sun Apr 23 03:42:10 2023] GET /compute/v2.1 => generated 387 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 23 03:42:10 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi [None req-dff01c17-6ba2-470b-9ba3-212a49958d92 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds512M", "ram": 512, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 1, "swap": 0, "disk": 5, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d1"}} {{(pid=61307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 03:42:10 user devstack@n-api.service[61307]: INFO nova.api.openstack.requestlog [None req-dff01c17-6ba2-470b-9ba3-212a49958d92 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.064023 Apr 23 03:42:10 user devstack@n-api.service[61307]: [pid: 61307|app: 0|req: 4/8] 10.0.0.210 () {64 vars in 1276 bytes} [Sun Apr 23 03:42:10 2023] POST /compute/v2.1/flavors => generated 402 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 23 03:42:10 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi [None req-8a2f141f-35b8-4893-86b3-80a8a47364fc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 03:42:10 user devstack@n-api.service[61308]: INFO nova.api.openstack.requestlog [None req-8a2f141f-35b8-4893-86b3-80a8a47364fc admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030687 Apr 23 03:42:10 user devstack@n-api.service[61308]: [pid: 61308|app: 0|req: 3/9] 10.0.0.210 () {64 vars in 1329 bytes} [Sun Apr 23 03:42:10 2023] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 23 03:42:12 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi [None req-be3866cb-bdc8-4797-ae28-44d5139cdce6 None None] Calling method '>' {{(pid=61306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 03:42:12 user devstack@n-api.service[61306]: INFO nova.api.openstack.requestlog [None req-be3866cb-bdc8-4797-ae28-44d5139cdce6 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001392 Apr 23 03:42:12 user devstack@n-api.service[61306]: [pid: 61306|app: 0|req: 3/10] 10.0.0.210 () {54 vars in 924 bytes} [Sun Apr 23 03:42:12 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 23 03:42:12 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi [None req-912dd512-c86c-4292-b128-b99dd59f7c21 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "rxtx_factor": 1.0, "id": "d2", "swap": 0, "disk": 10, "ram": 1024, "name": "ds1G", "os-flavor-access:is_public": true}} {{(pid=61307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 03:42:12 user devstack@n-api.service[61307]: INFO nova.api.openstack.requestlog [None req-912dd512-c86c-4292-b128-b99dd59f7c21 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.057703 Apr 23 03:42:12 user devstack@n-api.service[61307]: [pid: 61307|app: 0|req: 5/11] 10.0.0.210 () {64 vars in 1276 bytes} [Sun Apr 23 03:42:12 2023] POST /compute/v2.1/flavors => generated 402 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 23 03:42:12 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi [None req-b92995de-389a-4d98-95ce-20740cf68440 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 03:42:12 user devstack@n-api.service[61308]: INFO nova.api.openstack.requestlog [None req-b92995de-389a-4d98-95ce-20740cf68440 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026647 Apr 23 03:42:12 user devstack@n-api.service[61308]: [pid: 61308|app: 0|req: 4/12] 10.0.0.210 () {64 vars in 1329 bytes} [Sun Apr 23 03:42:12 2023] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 23 03:42:14 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi [None req-be3866cb-bdc8-4797-ae28-44d5139cdce6 None None] Calling method '>' {{(pid=61306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 03:42:14 user devstack@n-api.service[61306]: INFO nova.api.openstack.requestlog [None req-be3866cb-bdc8-4797-ae28-44d5139cdce6 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001579 Apr 23 03:42:14 user devstack@n-api.service[61306]: [pid: 61306|app: 0|req: 4/13] 10.0.0.210 () {54 vars in 924 bytes} [Sun Apr 23 03:42:14 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 23 03:42:14 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi [None req-3026a410-022a-4bee-a131-d34566b7d540 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds2G", "disk": 10, "id": "d3", "vcpus": 2, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 2048, "os-flavor-access:is_public": true}} {{(pid=61307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 03:42:14 user devstack@n-api.service[61307]: INFO nova.api.openstack.requestlog [None req-3026a410-022a-4bee-a131-d34566b7d540 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.067105 Apr 23 03:42:14 user devstack@n-api.service[61307]: [pid: 61307|app: 0|req: 6/14] 10.0.0.210 () {64 vars in 1276 bytes} [Sun Apr 23 03:42:14 2023] POST /compute/v2.1/flavors => generated 402 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 23 03:42:14 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi [None req-6e032ea9-cd5e-4669-a727-b9dd30426e36 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 03:42:14 user devstack@n-api.service[61308]: INFO nova.api.openstack.requestlog [None req-6e032ea9-cd5e-4669-a727-b9dd30426e36 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026225 Apr 23 03:42:14 user devstack@n-api.service[61308]: [pid: 61308|app: 0|req: 5/15] 10.0.0.210 () {64 vars in 1329 bytes} [Sun Apr 23 03:42:14 2023] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 23 03:42:16 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi [None req-be3866cb-bdc8-4797-ae28-44d5139cdce6 None None] Calling method '>' {{(pid=61306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 03:42:16 user devstack@n-api.service[61306]: INFO nova.api.openstack.requestlog [None req-be3866cb-bdc8-4797-ae28-44d5139cdce6 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001464 Apr 23 03:42:16 user devstack@n-api.service[61306]: [pid: 61306|app: 0|req: 5/16] 10.0.0.210 () {54 vars in 924 bytes} [Sun Apr 23 03:42:16 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 23 03:42:16 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi [None req-2d28b670-cdde-4879-82d1-1a671638dbf9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "d4", "ram": 4096, "disk": 20, "name": "ds4G", "vcpus": 4, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=61307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 03:42:16 user devstack@n-api.service[61307]: INFO nova.api.openstack.requestlog [None req-2d28b670-cdde-4879-82d1-1a671638dbf9 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.060924 Apr 23 03:42:16 user devstack@n-api.service[61307]: [pid: 61307|app: 0|req: 7/17] 10.0.0.210 () {64 vars in 1276 bytes} [Sun Apr 23 03:42:16 2023] POST /compute/v2.1/flavors => generated 402 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 23 03:42:16 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi [None req-ee2f28d7-d1f2-4a9e-8a5a-39a531e4ac1f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 03:42:16 user devstack@n-api.service[61308]: INFO nova.api.openstack.requestlog [None req-ee2f28d7-d1f2-4a9e-8a5a-39a531e4ac1f admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.024092 Apr 23 03:42:16 user devstack@n-api.service[61308]: [pid: 61308|app: 0|req: 6/18] 10.0.0.210 () {64 vars in 1329 bytes} [Sun Apr 23 03:42:16 2023] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 23 03:42:18 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi [None req-be3866cb-bdc8-4797-ae28-44d5139cdce6 None None] Calling method '>' {{(pid=61306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 03:42:18 user devstack@n-api.service[61306]: INFO nova.api.openstack.requestlog [None req-be3866cb-bdc8-4797-ae28-44d5139cdce6 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001379 Apr 23 03:42:18 user devstack@n-api.service[61306]: [pid: 61306|app: 0|req: 6/19] 10.0.0.210 () {54 vars in 924 bytes} [Sun Apr 23 03:42:18 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 23 03:42:18 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi [None req-f57495ac-3999-46ab-9b19-63aaaf915c89 admin admin] Calling method '>' {{(pid=61307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 03:42:18 user devstack@n-api.service[61307]: INFO nova.api.openstack.requestlog [None req-f57495ac-3999-46ab-9b19-63aaaf915c89 admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2096 microversion: 2.61 time: 0.075878 Apr 23 03:42:18 user devstack@n-api.service[61307]: [pid: 61307|app: 0|req: 8/20] 10.0.0.210 () {60 vars in 1285 bytes} [Sun Apr 23 03:42:18 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 2096 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 23 03:42:20 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi [None req-ee2f28d7-d1f2-4a9e-8a5a-39a531e4ac1f admin admin] Calling method '>' {{(pid=61308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 03:42:20 user devstack@n-api.service[61308]: INFO nova.api.openstack.requestlog [None req-ee2f28d7-d1f2-4a9e-8a5a-39a531e4ac1f admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001780 Apr 23 03:42:20 user devstack@n-api.service[61308]: [pid: 61308|app: 0|req: 7/21] 10.0.0.210 () {54 vars in 924 bytes} [Sun Apr 23 03:42:20 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 23 03:42:20 user devstack@n-api.service[61306]: DEBUG dbcounter [-] [61306] Writing DB stats nova_api:SELECT=3 {{(pid=61306) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:42:20 user devstack@n-api.service[61306]: DEBUG dbcounter [-] [61306] Writing DB stats nova_cell0:SELECT=3 {{(pid=61306) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:42:20 user devstack@n-api.service[61306]: DEBUG dbcounter [-] [61306] Writing DB stats nova_cell1:SELECT=3 {{(pid=61306) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:42:20 user devstack@n-api.service[61306]: DEBUG dbcounter [-] [61306] Writing DB stats nova_cell0:SELECT=3 {{(pid=61306) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:42:20 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi [None req-0f2c725c-ea34-4974-80e0-500f529ddc8b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.tiny", "swap": 0, "id": "1", "rxtx_factor": 1.0, "disk": 1, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "vcpus": 1}} {{(pid=61306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 03:42:20 user devstack@n-api.service[61306]: INFO nova.api.openstack.requestlog [None req-0f2c725c-ea34-4974-80e0-500f529ddc8b admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 400 microversion: 2.61 time: 0.314298 Apr 23 03:42:20 user devstack@n-api.service[61306]: [pid: 61306|app: 0|req: 7/22] 10.0.0.210 () {64 vars in 1276 bytes} [Sun Apr 23 03:42:20 2023] POST /compute/v2.1/flavors => generated 400 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 23 03:42:20 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi [None req-30f175db-0a72-4b44-b249-c781a9fc3a52 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 03:42:20 user devstack@n-api.service[61307]: INFO nova.api.openstack.requestlog [None req-30f175db-0a72-4b44-b249-c781a9fc3a52 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.050040 Apr 23 03:42:20 user devstack@n-api.service[61307]: [pid: 61307|app: 0|req: 9/23] 10.0.0.210 () {64 vars in 1326 bytes} [Sun Apr 23 03:42:20 2023] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 23 03:42:22 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi [None req-ee2f28d7-d1f2-4a9e-8a5a-39a531e4ac1f admin admin] Calling method '>' {{(pid=61308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 03:42:22 user devstack@n-api.service[61308]: INFO nova.api.openstack.requestlog [None req-ee2f28d7-d1f2-4a9e-8a5a-39a531e4ac1f admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001466 Apr 23 03:42:22 user devstack@n-api.service[61308]: [pid: 61308|app: 0|req: 8/24] 10.0.0.210 () {54 vars in 924 bytes} [Sun Apr 23 03:42:22 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 23 03:42:22 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi [None req-ae835357-6865-4b65-8a72-582aa393c392 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "name": "m1.small", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 1, "id": "2", "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=61306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 03:42:22 user devstack@n-api.service[61306]: INFO nova.api.openstack.requestlog [None req-ae835357-6865-4b65-8a72-582aa393c392 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.066911 Apr 23 03:42:22 user devstack@n-api.service[61306]: [pid: 61306|app: 0|req: 8/25] 10.0.0.210 () {64 vars in 1276 bytes} [Sun Apr 23 03:42:22 2023] POST /compute/v2.1/flavors => generated 403 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 23 03:42:22 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi [None req-bc4c7469-461d-44d9-9dd7-7d1e4fb54d49 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 03:42:22 user devstack@n-api.service[61307]: INFO nova.api.openstack.requestlog [None req-bc4c7469-461d-44d9-9dd7-7d1e4fb54d49 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025362 Apr 23 03:42:22 user devstack@n-api.service[61307]: [pid: 61307|app: 0|req: 10/26] 10.0.0.210 () {64 vars in 1326 bytes} [Sun Apr 23 03:42:22 2023] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 23 03:42:24 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi [None req-ee2f28d7-d1f2-4a9e-8a5a-39a531e4ac1f admin admin] Calling method '>' {{(pid=61308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 03:42:24 user devstack@n-api.service[61308]: INFO nova.api.openstack.requestlog [None req-ee2f28d7-d1f2-4a9e-8a5a-39a531e4ac1f admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001307 Apr 23 03:42:24 user devstack@n-api.service[61308]: [pid: 61308|app: 0|req: 9/27] 10.0.0.210 () {54 vars in 924 bytes} [Sun Apr 23 03:42:24 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 23 03:42:24 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi [None req-48e2313c-a626-410f-b4df-5e5d2e02ec9a admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "name": "m1.medium", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 4096, "os-flavor-access:is_public": true, "disk": 40, "swap": 0, "id": "3"}} {{(pid=61306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 03:42:24 user devstack@n-api.service[61306]: INFO nova.api.openstack.requestlog [None req-48e2313c-a626-410f-b4df-5e5d2e02ec9a admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.060106 Apr 23 03:42:24 user devstack@n-api.service[61306]: [pid: 61306|app: 0|req: 9/28] 10.0.0.210 () {64 vars in 1276 bytes} [Sun Apr 23 03:42:24 2023] POST /compute/v2.1/flavors => generated 404 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 23 03:42:24 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi [None req-1f6f2d74-cc76-4f3b-b41e-994f2905ac59 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 03:42:24 user devstack@n-api.service[61307]: INFO nova.api.openstack.requestlog [None req-1f6f2d74-cc76-4f3b-b41e-994f2905ac59 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.023544 Apr 23 03:42:24 user devstack@n-api.service[61307]: [pid: 61307|app: 0|req: 11/29] 10.0.0.210 () {64 vars in 1326 bytes} [Sun Apr 23 03:42:24 2023] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 23 03:42:26 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi [None req-ee2f28d7-d1f2-4a9e-8a5a-39a531e4ac1f admin admin] Calling method '>' {{(pid=61308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 03:42:26 user devstack@n-api.service[61308]: INFO nova.api.openstack.requestlog [None req-ee2f28d7-d1f2-4a9e-8a5a-39a531e4ac1f admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001382 Apr 23 03:42:26 user devstack@n-api.service[61308]: [pid: 61308|app: 0|req: 10/30] 10.0.0.210 () {54 vars in 924 bytes} [Sun Apr 23 03:42:26 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 23 03:42:26 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi [None req-b58ca1bf-9432-4f59-adfe-ab742ca699e7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "name": "m1.large", "disk": 80, "id": "4", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 8192, "vcpus": 4}} {{(pid=61306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 03:42:26 user devstack@n-api.service[61306]: INFO nova.api.openstack.requestlog [None req-b58ca1bf-9432-4f59-adfe-ab742ca699e7 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.083389 Apr 23 03:42:26 user devstack@n-api.service[61306]: [pid: 61306|app: 0|req: 10/31] 10.0.0.210 () {64 vars in 1276 bytes} [Sun Apr 23 03:42:26 2023] POST /compute/v2.1/flavors => generated 403 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 23 03:42:26 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi [None req-9e8bdd78-d6e7-425f-8cd9-aea29332602e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 03:42:26 user devstack@n-api.service[61307]: INFO nova.api.openstack.requestlog [None req-9e8bdd78-d6e7-425f-8cd9-aea29332602e admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.042566 Apr 23 03:42:26 user devstack@n-api.service[61307]: [pid: 61307|app: 0|req: 12/32] 10.0.0.210 () {64 vars in 1326 bytes} [Sun Apr 23 03:42:26 2023] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 23 03:42:28 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi [None req-ee2f28d7-d1f2-4a9e-8a5a-39a531e4ac1f admin admin] Calling method '>' {{(pid=61308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 03:42:28 user devstack@n-api.service[61308]: INFO nova.api.openstack.requestlog [None req-ee2f28d7-d1f2-4a9e-8a5a-39a531e4ac1f admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001418 Apr 23 03:42:28 user devstack@n-api.service[61308]: [pid: 61308|app: 0|req: 11/33] 10.0.0.210 () {54 vars in 924 bytes} [Sun Apr 23 03:42:28 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 23 03:42:28 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi [None req-2bba7a79-dc72-4c8b-95c1-6cdd271535d6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "5", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "m1.xlarge", "disk": 160, "ram": 16384, "vcpus": 8}} {{(pid=61306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 03:42:28 user devstack@n-api.service[61306]: INFO nova.api.openstack.requestlog [None req-2bba7a79-dc72-4c8b-95c1-6cdd271535d6 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.084527 Apr 23 03:42:28 user devstack@n-api.service[61306]: [pid: 61306|app: 0|req: 11/34] 10.0.0.210 () {64 vars in 1276 bytes} [Sun Apr 23 03:42:28 2023] POST /compute/v2.1/flavors => generated 406 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 23 03:42:28 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi [None req-7d49d04c-4379-4458-94d5-19b3d738df37 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 03:42:28 user devstack@n-api.service[61307]: INFO nova.api.openstack.requestlog [None req-7d49d04c-4379-4458-94d5-19b3d738df37 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.024041 Apr 23 03:42:28 user devstack@n-api.service[61307]: [pid: 61307|app: 0|req: 13/35] 10.0.0.210 () {64 vars in 1326 bytes} [Sun Apr 23 03:42:28 2023] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 23 03:43:00 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi [None req-ee2f28d7-d1f2-4a9e-8a5a-39a531e4ac1f admin admin] Calling method '>' {{(pid=61308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 03:43:00 user devstack@n-api.service[61308]: INFO nova.api.openstack.requestlog [None req-ee2f28d7-d1f2-4a9e-8a5a-39a531e4ac1f admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002268 Apr 23 03:43:00 user devstack@n-api.service[61308]: [pid: 61308|app: 0|req: 12/36] 10.0.0.210 () {58 vars in 1006 bytes} [Sun Apr 23 03:43:00 2023] GET /compute/v2.1 => generated 387 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 23 03:43:00 user devstack@n-api.service[61306]: DEBUG dbcounter [-] [61306] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=5 {{(pid=61306) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:43:00 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi [None req-5ff84da7-0559-4643-8398-f2bad5b074ec admin admin] Calling method '>' {{(pid=61306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 03:43:00 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-5ff84da7-0559-4643-8398-f2bad5b074ec admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:43:00 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-5ff84da7-0559-4643-8398-f2bad5b074ec admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:43:00 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-5ff84da7-0559-4643-8398-f2bad5b074ec admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:43:00 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-5ff84da7-0559-4643-8398-f2bad5b074ec admin admin] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:43:00 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-5ff84da7-0559-4643-8398-f2bad5b074ec admin admin] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:43:00 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-5ff84da7-0559-4643-8398-f2bad5b074ec admin admin] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:43:00 user devstack@n-api.service[61306]: INFO nova.api.openstack.requestlog [None req-5ff84da7-0559-4643-8398-f2bad5b074ec admin admin] 10.0.0.210 "GET /compute/v2.1/os-services?binary=nova-compute&host=user" status: 200 len: 247 microversion: 2.69 time: 0.087752 Apr 23 03:43:00 user devstack@n-api.service[61306]: [pid: 61306|app: 0|req: 12/37] 10.0.0.210 () {64 vars in 1388 bytes} [Sun Apr 23 03:43:00 2023] GET /compute/v2.1/os-services?binary=nova-compute&host=user => generated 247 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 23 03:43:32 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi [None req-7d49d04c-4379-4458-94d5-19b3d738df37 admin admin] Calling method '>' {{(pid=61307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 03:43:32 user devstack@n-api.service[61307]: INFO nova.api.openstack.requestlog [None req-7d49d04c-4379-4458-94d5-19b3d738df37 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001594 Apr 23 03:43:32 user devstack@n-api.service[61307]: [pid: 61307|app: 0|req: 14/38] 10.0.0.210 () {58 vars in 1006 bytes} [Sun Apr 23 03:43:32 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 23 03:43:32 user devstack@n-api.service[61308]: DEBUG dbcounter [-] [61308] Writing DB stats nova_api:SELECT=32,nova_api:SAVEPOINT=5,nova_api:INSERT=5,nova_api:RELEASE=5 {{(pid=61308) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:43:32 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi [None req-73d2b8e7-68e0-44ca-b07a-5531aff69bdd admin admin] Calling method '>' {{(pid=61308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 03:43:32 user devstack@n-api.service[61308]: INFO nova.api.openstack.requestlog [None req-73d2b8e7-68e0-44ca-b07a-5531aff69bdd admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4182 microversion: 2.61 time: 0.073734 Apr 23 03:43:32 user devstack@n-api.service[61308]: [pid: 61308|app: 0|req: 13/39] 10.0.0.210 () {64 vars in 1367 bytes} [Sun Apr 23 03:43:32 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 4182 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 23 03:43:36 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi [None req-5ff84da7-0559-4643-8398-f2bad5b074ec admin admin] Calling method '>' {{(pid=61306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 03:43:36 user devstack@n-api.service[61306]: INFO nova.api.openstack.requestlog [None req-5ff84da7-0559-4643-8398-f2bad5b074ec admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001782 Apr 23 03:43:36 user devstack@n-api.service[61306]: [pid: 61306|app: 0|req: 13/40] 10.0.0.210 () {58 vars in 1006 bytes} [Sun Apr 23 03:43:36 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 23 03:43:36 user devstack@n-api.service[61307]: DEBUG dbcounter [-] [61307] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=61307) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:43:36 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi [None req-cbf383cf-9b38-455e-ad4a-ca426d7460bb admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "name": "m1.nano", "ram": 128, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 1, "vcpus": 1, "id": "42", "rxtx_factor": 1.0}} {{(pid=61307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 03:43:37 user devstack@n-api.service[61307]: INFO nova.api.openstack.requestlog [None req-cbf383cf-9b38-455e-ad4a-ca426d7460bb admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.063392 Apr 23 03:43:37 user devstack@n-api.service[61307]: [pid: 61307|app: 0|req: 15/41] 10.0.0.210 () {68 vars in 1358 bytes} [Sun Apr 23 03:43:36 2023] POST /compute/v2.1/flavors => generated 403 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 23 03:43:37 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi [None req-be0eb480-4be2-49a8-8d52-719564344162 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 03:43:37 user devstack@n-api.service[61308]: INFO nova.api.openstack.requestlog [None req-be0eb480-4be2-49a8-8d52-719564344162 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.024410 Apr 23 03:43:37 user devstack@n-api.service[61308]: [pid: 61308|app: 0|req: 14/42] 10.0.0.210 () {68 vars in 1411 bytes} [Sun Apr 23 03:43:37 2023] POST /compute/v2.1/flavors/42/os-extra_specs => generated 43 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 23 03:43:41 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi [None req-5ff84da7-0559-4643-8398-f2bad5b074ec admin admin] Calling method '>' {{(pid=61306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 03:43:41 user devstack@n-api.service[61306]: INFO nova.api.openstack.requestlog [None req-5ff84da7-0559-4643-8398-f2bad5b074ec admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001590 Apr 23 03:43:41 user devstack@n-api.service[61306]: [pid: 61306|app: 0|req: 14/43] 10.0.0.210 () {58 vars in 1006 bytes} [Sun Apr 23 03:43:41 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 23 03:43:41 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi [None req-9d524ee6-f5b8-4f70-af0d-31a518068759 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 192, "swap": 0, "name": "m1.micro", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "os-flavor-access:is_public": true, "id": "84", "disk": 1, "rxtx_factor": 1.0}} {{(pid=61307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 03:43:41 user devstack@n-api.service[61307]: INFO nova.api.openstack.requestlog [None req-9d524ee6-f5b8-4f70-af0d-31a518068759 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.058928 Apr 23 03:43:41 user devstack@n-api.service[61307]: [pid: 61307|app: 0|req: 16/44] 10.0.0.210 () {68 vars in 1358 bytes} [Sun Apr 23 03:43:41 2023] POST /compute/v2.1/flavors => generated 404 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 23 03:43:41 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi [None req-10d458d4-94b1-46ff-a870-43da5802f883 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 03:43:41 user devstack@n-api.service[61308]: INFO nova.api.openstack.requestlog [None req-10d458d4-94b1-46ff-a870-43da5802f883 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028090 Apr 23 03:43:41 user devstack@n-api.service[61308]: [pid: 61308|app: 0|req: 15/45] 10.0.0.210 () {68 vars in 1411 bytes} [Sun Apr 23 03:43:41 2023] POST /compute/v2.1/flavors/84/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 23 03:45:52 user devstack@n-api.service[61306]: DEBUG dbcounter [-] [61306] Writing DB stats nova_cell0:SELECT=2 {{(pid=61306) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:45:52 user devstack@n-api.service[61306]: DEBUG dbcounter [-] [61306] Writing DB stats nova_cell1:SELECT=2 {{(pid=61306) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:45:52 user devstack@n-api.service[61306]: DEBUG dbcounter [-] [61306] Writing DB stats nova_api:SELECT=4 {{(pid=61306) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:45:53 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi [None req-2135602d-bc4f-46b2-881e-57ec5d41362a tempest-VolumesNegativeTest-623906826 tempest-VolumesNegativeTest-623906826-project-member] Action: 'create', calling method: .version_select at 0x7f21e1ffd630>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-2037409364", "metadata": {"Type": "work"}}} {{(pid=61306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 03:45:53 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi [None req-2135602d-bc4f-46b2-881e-57ec5d41362a tempest-VolumesNegativeTest-623906826 tempest-VolumesNegativeTest-623906826-project-member] Request method failure captured: Apr 23 03:45:53 user devstack@n-api.service[61306]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Apr 23 03:45:53 user devstack@n-api.service[61306]: Accept: application/json Apr 23 03:45:53 user devstack@n-api.service[61306]: Accept-Encoding: identity Apr 23 03:45:53 user devstack@n-api.service[61306]: Connection: close Apr 23 03:45:53 user devstack@n-api.service[61306]: Content-Length: 122 Apr 23 03:45:53 user devstack@n-api.service[61306]: Content-Type: application/json Apr 23 03:45:53 user devstack@n-api.service[61306]: Host: 10.0.0.210 Apr 23 03:45:53 user devstack@n-api.service[61306]: Openstack-System-Scope: None Apr 23 03:45:53 user devstack@n-api.service[61306]: User-Agent: python-urllib3/1.26.15 Apr 23 03:45:53 user devstack@n-api.service[61306]: X-Auth-Token: gAAAAABkRKnwBvZ7XOMMliNdysMtpwgZ7OmNzO2vhKR5IhbhH5yUyLWzK8W_enMFC1zKYvgqD-GphGfCMF_mBgb3GxY29y2lKycwaUs0l332l3i1GWghDCZhwtDo_zmzOISpYZcYnJnIj0NcuGvM6RKTp8Scx72B9Ey9pKo_3C0KCuK6oABI7OY Apr 23 03:45:53 user devstack@n-api.service[61306]: X-Domain-Id: None Apr 23 03:45:53 user devstack@n-api.service[61306]: X-Domain-Name: None Apr 23 03:45:53 user devstack@n-api.service[61306]: X-Identity-Status: Confirmed Apr 23 03:45:53 user devstack@n-api.service[61306]: X-Is-Admin-Project: True Apr 23 03:45:53 user devstack@n-api.service[61306]: X-Project-Domain-Id: default Apr 23 03:45:53 user devstack@n-api.service[61306]: X-Project-Domain-Name: Default Apr 23 03:45:53 user devstack@n-api.service[61306]: X-Project-Id: 509c77b91a5c439d8151b9eac5b9e920 Apr 23 03:45:53 user devstack@n-api.service[61306]: X-Project-Name: tempest-VolumesNegativeTest-623906826 Apr 23 03:45:53 user devstack@n-api.service[61306]: X-Role: reader,member Apr 23 03:45:53 user devstack@n-api.service[61306]: X-Roles: reader,member Apr 23 03:45:53 user devstack@n-api.service[61306]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/509c77b91a5c439d8151b9eac5b9e920"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/509c77b91a5c439d8151b9eac5b9e920"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/509c77b91a5c439d8151b9eac5b9e920"}]}] Apr 23 03:45:53 user devstack@n-api.service[61306]: X-Tenant: tempest-VolumesNegativeTest-623906826 Apr 23 03:45:53 user devstack@n-api.service[61306]: X-Tenant-Id: 509c77b91a5c439d8151b9eac5b9e920 Apr 23 03:45:53 user devstack@n-api.service[61306]: X-Tenant-Name: tempest-VolumesNegativeTest-623906826 Apr 23 03:45:53 user devstack@n-api.service[61306]: X-User: tempest-VolumesNegativeTest-623906826-project-member Apr 23 03:45:53 user devstack@n-api.service[61306]: X-User-Domain-Id: default Apr 23 03:45:53 user devstack@n-api.service[61306]: X-User-Domain-Name: Default Apr 23 03:45:53 user devstack@n-api.service[61306]: X-User-Id: ff936c80d08f44b392b07257d09d53a3 Apr 23 03:45:53 user devstack@n-api.service[61306]: X-User-Name: tempest-VolumesNegativeTest-623906826-project-member Apr 23 03:45:53 user devstack@n-api.service[61306]: Apr 23 03:45:53 user devstack@n-api.service[61306]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-2037409364", "metadata": {"Type": "work"}}} Apr 23 03:45:53 user devstack@n-api.service[61306]: method: Apr 23 03:45:53 user devstack@n-api.service[61306]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Apr 23 03:45:53 user devstack@n-api.service[61306]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-2037409364', 'metadata': {'Type': 'work'}}}} Apr 23 03:45:53 user devstack@n-api.service[61306]: {{(pid=61306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 23 03:45:53 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 23 03:45:53 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 23 03:45:53 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 23 03:45:53 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 23 03:45:53 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi raise error Apr 23 03:45:53 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Apr 23 03:45:53 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi Apr 23 03:45:53 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Apr 23 03:45:53 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Apr 23 03:45:53 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi Apr 23 03:45:53 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi On instance['volume']: Apr 23 03:45:53 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi '#$%' Apr 23 03:45:53 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi Apr 23 03:45:53 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 23 03:45:53 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi Apr 23 03:45:53 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 23 03:45:53 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 23 03:45:53 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 23 03:45:53 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 23 03:45:53 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 23 03:45:53 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 23 03:45:53 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 23 03:45:53 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 23 03:45:53 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 23 03:45:53 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 23 03:45:53 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 23 03:45:53 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 23 03:45:53 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 23 03:45:53 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 23 03:45:53 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 23 03:45:53 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Apr 23 03:45:53 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi Apr 23 03:45:53 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 23 03:45:53 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi Apr 23 03:45:53 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 23 03:45:53 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 23 03:45:53 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 23 03:45:53 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 23 03:45:53 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 23 03:45:53 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Apr 23 03:45:53 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi Apr 23 03:45:53 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi [None req-2135602d-bc4f-46b2-881e-57ec5d41362a tempest-VolumesNegativeTest-623906826 tempest-VolumesNegativeTest-623906826-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=61306) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 23 03:45:53 user devstack@n-api.service[61306]: INFO nova.api.openstack.requestlog [None req-2135602d-bc4f-46b2-881e-57ec5d41362a tempest-VolumesNegativeTest-623906826 tempest-VolumesNegativeTest-623906826-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.520782 Apr 23 03:45:53 user devstack@n-api.service[61306]: [pid: 61306|app: 0|req: 15/46] 10.0.0.210 () {64 vars in 1233 bytes} [Sun Apr 23 03:45:52 2023] POST /compute/v2.1/os-volumes => generated 127 bytes in 523 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 23 03:45:53 user devstack@n-api.service[61307]: DEBUG dbcounter [-] [61307] Writing DB stats nova_api:SELECT=6,nova_api:INSERT=2 {{(pid=61307) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:45:53 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi [None req-b9d2f30b-c6c1-44bb-b22f-6bce5f49c577 tempest-VolumesNegativeTest-623906826 tempest-VolumesNegativeTest-623906826-project-member] Action: 'create', calling method: .version_select at 0x7f21e1f72680>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-69962914", "metadata": {"Type": "work"}}} {{(pid=61307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 03:45:53 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi [None req-b9d2f30b-c6c1-44bb-b22f-6bce5f49c577 tempest-VolumesNegativeTest-623906826 tempest-VolumesNegativeTest-623906826-project-member] Request method failure captured: Apr 23 03:45:53 user devstack@n-api.service[61307]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Apr 23 03:45:53 user devstack@n-api.service[61307]: Accept: application/json Apr 23 03:45:53 user devstack@n-api.service[61307]: Accept-Encoding: identity Apr 23 03:45:53 user devstack@n-api.service[61307]: Connection: close Apr 23 03:45:53 user devstack@n-api.service[61307]: Content-Length: 118 Apr 23 03:45:53 user devstack@n-api.service[61307]: Content-Type: application/json Apr 23 03:45:53 user devstack@n-api.service[61307]: Host: 10.0.0.210 Apr 23 03:45:53 user devstack@n-api.service[61307]: Openstack-System-Scope: None Apr 23 03:45:53 user devstack@n-api.service[61307]: User-Agent: python-urllib3/1.26.15 Apr 23 03:45:53 user devstack@n-api.service[61307]: X-Auth-Token: gAAAAABkRKnwBvZ7XOMMliNdysMtpwgZ7OmNzO2vhKR5IhbhH5yUyLWzK8W_enMFC1zKYvgqD-GphGfCMF_mBgb3GxY29y2lKycwaUs0l332l3i1GWghDCZhwtDo_zmzOISpYZcYnJnIj0NcuGvM6RKTp8Scx72B9Ey9pKo_3C0KCuK6oABI7OY Apr 23 03:45:53 user devstack@n-api.service[61307]: X-Domain-Id: None Apr 23 03:45:53 user devstack@n-api.service[61307]: X-Domain-Name: None Apr 23 03:45:53 user devstack@n-api.service[61307]: X-Identity-Status: Confirmed Apr 23 03:45:53 user devstack@n-api.service[61307]: X-Is-Admin-Project: True Apr 23 03:45:53 user devstack@n-api.service[61307]: X-Project-Domain-Id: default Apr 23 03:45:53 user devstack@n-api.service[61307]: X-Project-Domain-Name: Default Apr 23 03:45:53 user devstack@n-api.service[61307]: X-Project-Id: 509c77b91a5c439d8151b9eac5b9e920 Apr 23 03:45:53 user devstack@n-api.service[61307]: X-Project-Name: tempest-VolumesNegativeTest-623906826 Apr 23 03:45:53 user devstack@n-api.service[61307]: X-Role: reader,member Apr 23 03:45:53 user devstack@n-api.service[61307]: X-Roles: reader,member Apr 23 03:45:53 user devstack@n-api.service[61307]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/509c77b91a5c439d8151b9eac5b9e920"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/509c77b91a5c439d8151b9eac5b9e920"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/509c77b91a5c439d8151b9eac5b9e920"}]}] Apr 23 03:45:53 user devstack@n-api.service[61307]: X-Tenant: tempest-VolumesNegativeTest-623906826 Apr 23 03:45:53 user devstack@n-api.service[61307]: X-Tenant-Id: 509c77b91a5c439d8151b9eac5b9e920 Apr 23 03:45:53 user devstack@n-api.service[61307]: X-Tenant-Name: tempest-VolumesNegativeTest-623906826 Apr 23 03:45:53 user devstack@n-api.service[61307]: X-User: tempest-VolumesNegativeTest-623906826-project-member Apr 23 03:45:53 user devstack@n-api.service[61307]: X-User-Domain-Id: default Apr 23 03:45:53 user devstack@n-api.service[61307]: X-User-Domain-Name: Default Apr 23 03:45:53 user devstack@n-api.service[61307]: X-User-Id: ff936c80d08f44b392b07257d09d53a3 Apr 23 03:45:53 user devstack@n-api.service[61307]: X-User-Name: tempest-VolumesNegativeTest-623906826-project-member Apr 23 03:45:53 user devstack@n-api.service[61307]: Apr 23 03:45:53 user devstack@n-api.service[61307]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-69962914", "metadata": {"Type": "work"}}} Apr 23 03:45:53 user devstack@n-api.service[61307]: method: Apr 23 03:45:53 user devstack@n-api.service[61307]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Apr 23 03:45:53 user devstack@n-api.service[61307]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-69962914', 'metadata': {'Type': 'work'}}}} Apr 23 03:45:53 user devstack@n-api.service[61307]: {{(pid=61307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 23 03:45:53 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 23 03:45:53 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 23 03:45:53 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 23 03:45:53 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 23 03:45:53 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi raise error Apr 23 03:45:53 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Apr 23 03:45:53 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi Apr 23 03:45:53 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Apr 23 03:45:53 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Apr 23 03:45:53 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi Apr 23 03:45:53 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi On instance['volume']: Apr 23 03:45:53 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi '0' Apr 23 03:45:53 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi Apr 23 03:45:53 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 23 03:45:53 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi Apr 23 03:45:53 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 23 03:45:53 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 23 03:45:53 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 23 03:45:53 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 23 03:45:53 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 23 03:45:53 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 23 03:45:53 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 23 03:45:53 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 23 03:45:53 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 23 03:45:53 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 23 03:45:53 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 23 03:45:53 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 23 03:45:53 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 23 03:45:53 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 23 03:45:53 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 23 03:45:53 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Apr 23 03:45:53 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi Apr 23 03:45:53 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 23 03:45:53 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi Apr 23 03:45:53 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 23 03:45:53 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 23 03:45:53 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 23 03:45:53 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 23 03:45:53 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 23 03:45:53 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Apr 23 03:45:53 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi Apr 23 03:45:53 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi [None req-b9d2f30b-c6c1-44bb-b22f-6bce5f49c577 tempest-VolumesNegativeTest-623906826 tempest-VolumesNegativeTest-623906826-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=61307) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 23 03:45:53 user devstack@n-api.service[61307]: INFO nova.api.openstack.requestlog [None req-b9d2f30b-c6c1-44bb-b22f-6bce5f49c577 tempest-VolumesNegativeTest-623906826 tempest-VolumesNegativeTest-623906826-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.015174 Apr 23 03:45:53 user devstack@n-api.service[61307]: [pid: 61307|app: 0|req: 17/47] 10.0.0.210 () {64 vars in 1233 bytes} [Sun Apr 23 03:45:53 2023] POST /compute/v2.1/os-volumes => generated 125 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 23 03:45:53 user devstack@n-api.service[61308]: DEBUG dbcounter [-] [61308] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=2,nova_api:RELEASE=2 {{(pid=61308) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:45:53 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi [None req-bc9e0708-fabe-4a96-a89e-49f2194ab720 tempest-VolumesNegativeTest-623906826 tempest-VolumesNegativeTest-623906826-project-member] Action: 'create', calling method: .version_select at 0x7f21e1f760e0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1714160215", "metadata": {"Type": "work"}}} {{(pid=61308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 03:45:53 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi [None req-bc9e0708-fabe-4a96-a89e-49f2194ab720 tempest-VolumesNegativeTest-623906826 tempest-VolumesNegativeTest-623906826-project-member] Request method failure captured: Apr 23 03:45:53 user devstack@n-api.service[61308]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Apr 23 03:45:53 user devstack@n-api.service[61308]: Accept: application/json Apr 23 03:45:53 user devstack@n-api.service[61308]: Accept-Encoding: identity Apr 23 03:45:53 user devstack@n-api.service[61308]: Connection: close Apr 23 03:45:53 user devstack@n-api.service[61308]: Content-Length: 119 Apr 23 03:45:53 user devstack@n-api.service[61308]: Content-Type: application/json Apr 23 03:45:53 user devstack@n-api.service[61308]: Host: 10.0.0.210 Apr 23 03:45:53 user devstack@n-api.service[61308]: Openstack-System-Scope: None Apr 23 03:45:53 user devstack@n-api.service[61308]: User-Agent: python-urllib3/1.26.15 Apr 23 03:45:53 user devstack@n-api.service[61308]: X-Auth-Token: gAAAAABkRKnwBvZ7XOMMliNdysMtpwgZ7OmNzO2vhKR5IhbhH5yUyLWzK8W_enMFC1zKYvgqD-GphGfCMF_mBgb3GxY29y2lKycwaUs0l332l3i1GWghDCZhwtDo_zmzOISpYZcYnJnIj0NcuGvM6RKTp8Scx72B9Ey9pKo_3C0KCuK6oABI7OY Apr 23 03:45:53 user devstack@n-api.service[61308]: X-Domain-Id: None Apr 23 03:45:53 user devstack@n-api.service[61308]: X-Domain-Name: None Apr 23 03:45:53 user devstack@n-api.service[61308]: X-Identity-Status: Confirmed Apr 23 03:45:53 user devstack@n-api.service[61308]: X-Is-Admin-Project: True Apr 23 03:45:53 user devstack@n-api.service[61308]: X-Project-Domain-Id: default Apr 23 03:45:53 user devstack@n-api.service[61308]: X-Project-Domain-Name: Default Apr 23 03:45:53 user devstack@n-api.service[61308]: X-Project-Id: 509c77b91a5c439d8151b9eac5b9e920 Apr 23 03:45:53 user devstack@n-api.service[61308]: X-Project-Name: tempest-VolumesNegativeTest-623906826 Apr 23 03:45:53 user devstack@n-api.service[61308]: X-Role: reader,member Apr 23 03:45:53 user devstack@n-api.service[61308]: X-Roles: reader,member Apr 23 03:45:53 user devstack@n-api.service[61308]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/509c77b91a5c439d8151b9eac5b9e920"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/509c77b91a5c439d8151b9eac5b9e920"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/509c77b91a5c439d8151b9eac5b9e920"}]}] Apr 23 03:45:53 user devstack@n-api.service[61308]: X-Tenant: tempest-VolumesNegativeTest-623906826 Apr 23 03:45:53 user devstack@n-api.service[61308]: X-Tenant-Id: 509c77b91a5c439d8151b9eac5b9e920 Apr 23 03:45:53 user devstack@n-api.service[61308]: X-Tenant-Name: tempest-VolumesNegativeTest-623906826 Apr 23 03:45:53 user devstack@n-api.service[61308]: X-User: tempest-VolumesNegativeTest-623906826-project-member Apr 23 03:45:53 user devstack@n-api.service[61308]: X-User-Domain-Id: default Apr 23 03:45:53 user devstack@n-api.service[61308]: X-User-Domain-Name: Default Apr 23 03:45:53 user devstack@n-api.service[61308]: X-User-Id: ff936c80d08f44b392b07257d09d53a3 Apr 23 03:45:53 user devstack@n-api.service[61308]: X-User-Name: tempest-VolumesNegativeTest-623906826-project-member Apr 23 03:45:53 user devstack@n-api.service[61308]: Apr 23 03:45:53 user devstack@n-api.service[61308]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1714160215", "metadata": {"Type": "work"}}} Apr 23 03:45:53 user devstack@n-api.service[61308]: method: Apr 23 03:45:53 user devstack@n-api.service[61308]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Apr 23 03:45:53 user devstack@n-api.service[61308]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1714160215', 'metadata': {'Type': 'work'}}}} Apr 23 03:45:53 user devstack@n-api.service[61308]: {{(pid=61308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 23 03:45:53 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 23 03:45:53 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 23 03:45:53 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 23 03:45:53 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 23 03:45:53 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi raise error Apr 23 03:45:53 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Apr 23 03:45:53 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi Apr 23 03:45:53 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Apr 23 03:45:53 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Apr 23 03:45:53 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi Apr 23 03:45:53 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi On instance['volume']: Apr 23 03:45:53 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi '' Apr 23 03:45:53 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi Apr 23 03:45:53 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 23 03:45:53 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi Apr 23 03:45:53 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 23 03:45:53 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 23 03:45:53 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 23 03:45:53 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 23 03:45:53 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 23 03:45:53 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 23 03:45:53 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 23 03:45:53 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 23 03:45:53 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 23 03:45:53 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 23 03:45:53 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 23 03:45:53 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 23 03:45:53 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 23 03:45:53 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 23 03:45:53 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 23 03:45:53 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Apr 23 03:45:53 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi Apr 23 03:45:53 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 23 03:45:53 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi Apr 23 03:45:53 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 23 03:45:53 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 23 03:45:53 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 23 03:45:53 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 23 03:45:53 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 23 03:45:53 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Apr 23 03:45:53 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi Apr 23 03:45:53 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi [None req-bc9e0708-fabe-4a96-a89e-49f2194ab720 tempest-VolumesNegativeTest-623906826 tempest-VolumesNegativeTest-623906826-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=61308) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 23 03:45:53 user devstack@n-api.service[61308]: INFO nova.api.openstack.requestlog [None req-bc9e0708-fabe-4a96-a89e-49f2194ab720 tempest-VolumesNegativeTest-623906826 tempest-VolumesNegativeTest-623906826-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.015331 Apr 23 03:45:53 user devstack@n-api.service[61308]: [pid: 61308|app: 0|req: 16/48] 10.0.0.210 () {64 vars in 1233 bytes} [Sun Apr 23 03:45:53 2023] POST /compute/v2.1/os-volumes => generated 121 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 23 03:45:53 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi [None req-fd485422-c760-4a5f-8af9-7ac90d66198f tempest-VolumesNegativeTest-623906826 tempest-VolumesNegativeTest-623906826-project-member] Calling method '.version_select at 0x7f21e29e3eb0>' {{(pid=61306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 03:45:53 user devstack@n-api.service[61306]: INFO nova.api.openstack.wsgi [None req-fd485422-c760-4a5f-8af9-7ac90d66198f tempest-VolumesNegativeTest-623906826 tempest-VolumesNegativeTest-623906826-project-member] HTTP exception thrown: Volume tempest-invalid-2027741329 could not be found. Apr 23 03:45:53 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi [None req-fd485422-c760-4a5f-8af9-7ac90d66198f tempest-VolumesNegativeTest-623906826 tempest-VolumesNegativeTest-623906826-project-member] Request method failure captured: Apr 23 03:45:53 user devstack@n-api.service[61306]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-2027741329 HTTP/1.1 Apr 23 03:45:53 user devstack@n-api.service[61306]: Accept: application/json Apr 23 03:45:53 user devstack@n-api.service[61306]: Accept-Encoding: identity Apr 23 03:45:53 user devstack@n-api.service[61306]: Connection: close Apr 23 03:45:53 user devstack@n-api.service[61306]: Content-Length: 0 Apr 23 03:45:53 user devstack@n-api.service[61306]: Content-Type: application/json Apr 23 03:45:53 user devstack@n-api.service[61306]: Host: 10.0.0.210 Apr 23 03:45:53 user devstack@n-api.service[61306]: Openstack-System-Scope: None Apr 23 03:45:53 user devstack@n-api.service[61306]: User-Agent: python-urllib3/1.26.15 Apr 23 03:45:53 user devstack@n-api.service[61306]: X-Auth-Token: gAAAAABkRKnwBvZ7XOMMliNdysMtpwgZ7OmNzO2vhKR5IhbhH5yUyLWzK8W_enMFC1zKYvgqD-GphGfCMF_mBgb3GxY29y2lKycwaUs0l332l3i1GWghDCZhwtDo_zmzOISpYZcYnJnIj0NcuGvM6RKTp8Scx72B9Ey9pKo_3C0KCuK6oABI7OY Apr 23 03:45:53 user devstack@n-api.service[61306]: X-Domain-Id: None Apr 23 03:45:53 user devstack@n-api.service[61306]: X-Domain-Name: None Apr 23 03:45:53 user devstack@n-api.service[61306]: X-Identity-Status: Confirmed Apr 23 03:45:53 user devstack@n-api.service[61306]: X-Is-Admin-Project: True Apr 23 03:45:53 user devstack@n-api.service[61306]: X-Project-Domain-Id: default Apr 23 03:45:53 user devstack@n-api.service[61306]: X-Project-Domain-Name: Default Apr 23 03:45:53 user devstack@n-api.service[61306]: X-Project-Id: 509c77b91a5c439d8151b9eac5b9e920 Apr 23 03:45:53 user devstack@n-api.service[61306]: X-Project-Name: tempest-VolumesNegativeTest-623906826 Apr 23 03:45:53 user devstack@n-api.service[61306]: X-Role: reader,member Apr 23 03:45:53 user devstack@n-api.service[61306]: X-Roles: reader,member Apr 23 03:45:53 user devstack@n-api.service[61306]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/509c77b91a5c439d8151b9eac5b9e920"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/509c77b91a5c439d8151b9eac5b9e920"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/509c77b91a5c439d8151b9eac5b9e920"}]}] Apr 23 03:45:53 user devstack@n-api.service[61306]: X-Tenant: tempest-VolumesNegativeTest-623906826 Apr 23 03:45:53 user devstack@n-api.service[61306]: X-Tenant-Id: 509c77b91a5c439d8151b9eac5b9e920 Apr 23 03:45:53 user devstack@n-api.service[61306]: X-Tenant-Name: tempest-VolumesNegativeTest-623906826 Apr 23 03:45:53 user devstack@n-api.service[61306]: X-User: tempest-VolumesNegativeTest-623906826-project-member Apr 23 03:45:53 user devstack@n-api.service[61306]: X-User-Domain-Id: default Apr 23 03:45:53 user devstack@n-api.service[61306]: X-User-Domain-Name: Default Apr 23 03:45:53 user devstack@n-api.service[61306]: X-User-Id: ff936c80d08f44b392b07257d09d53a3 Apr 23 03:45:53 user devstack@n-api.service[61306]: X-User-Name: tempest-VolumesNegativeTest-623906826-project-member Apr 23 03:45:53 user devstack@n-api.service[61306]: method: Apr 23 03:45:53 user devstack@n-api.service[61306]: exception: Volume tempest-invalid-2027741329 could not be found. Apr 23 03:45:53 user devstack@n-api.service[61306]: action_args: {'id': 'tempest-invalid-2027741329'} Apr 23 03:45:53 user devstack@n-api.service[61306]: {{(pid=61306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 23 03:45:53 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 23 03:45:53 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 23 03:45:53 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 23 03:45:53 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 23 03:45:53 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 23 03:45:53 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 23 03:45:53 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 23 03:45:53 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 23 03:45:53 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 23 03:45:53 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 23 03:45:53 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 23 03:45:53 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 23 03:45:53 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 23 03:45:53 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 23 03:45:53 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 23 03:45:53 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-2027741329 could not be found. (HTTP 404) (Request-ID: req-47e3485a-7abd-45fc-b455-b2cea1d95232) Apr 23 03:45:53 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi Apr 23 03:45:53 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 23 03:45:53 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi Apr 23 03:45:53 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 23 03:45:53 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Apr 23 03:45:53 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Apr 23 03:45:53 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 23 03:45:53 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 23 03:45:53 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 23 03:45:53 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 23 03:45:53 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 23 03:45:53 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 23 03:45:53 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 23 03:45:53 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 23 03:45:53 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 23 03:45:53 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 23 03:45:53 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 23 03:45:53 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 23 03:45:53 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 23 03:45:53 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 23 03:45:53 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 23 03:45:53 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 23 03:45:53 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 23 03:45:53 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 23 03:45:53 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 23 03:45:53 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 23 03:45:53 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-2027741329 could not be found. Apr 23 03:45:53 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi Apr 23 03:45:53 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 23 03:45:53 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi Apr 23 03:45:53 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 23 03:45:53 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 23 03:45:53 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 23 03:45:53 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 23 03:45:53 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 23 03:45:53 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 23 03:45:53 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 23 03:45:53 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 23 03:45:53 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 23 03:45:53 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Apr 23 03:45:53 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 23 03:45:53 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-2027741329 could not be found. Apr 23 03:45:53 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi Apr 23 03:45:53 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 23 03:45:53 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi Apr 23 03:45:53 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 23 03:45:53 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 23 03:45:53 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 23 03:45:53 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 23 03:45:53 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 23 03:45:53 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-2027741329 could not be found. Apr 23 03:45:53 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi Apr 23 03:45:53 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi [None req-fd485422-c760-4a5f-8af9-7ac90d66198f tempest-VolumesNegativeTest-623906826 tempest-VolumesNegativeTest-623906826-project-member] Returning 404 to user: Volume tempest-invalid-2027741329 could not be found. {{(pid=61306) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 23 03:45:53 user devstack@n-api.service[61306]: INFO nova.api.openstack.requestlog [None req-fd485422-c760-4a5f-8af9-7ac90d66198f tempest-VolumesNegativeTest-623906826 tempest-VolumesNegativeTest-623906826-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/tempest-invalid-2027741329" status: 404 len: 99 microversion: 2.1 time: 0.542046 Apr 23 03:45:53 user devstack@n-api.service[61306]: [pid: 61306|app: 0|req: 16/49] 10.0.0.210 () {62 vars in 1295 bytes} [Sun Apr 23 03:45:53 2023] DELETE /compute/v2.1/os-volumes/tempest-invalid-2027741329 => generated 99 bytes in 543 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 23 03:45:53 user devstack@n-api.service[61307]: INFO nova.api.openstack.requestlog [None req-dc9f2d35-71ab-4f86-8ff6-97da611e700e tempest-VolumesNegativeTest-623906826 tempest-VolumesNegativeTest-623906826-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.006162 Apr 23 03:45:53 user devstack@n-api.service[61307]: [pid: 61307|app: 0|req: 18/50] 10.0.0.210 () {62 vars in 1217 bytes} [Sun Apr 23 03:45:53 2023] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 8 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Apr 23 03:45:53 user devstack@n-api.service[61308]: INFO nova.api.openstack.requestlog [None req-df3d0fbe-f3fb-480a-829c-bc679da5283b tempest-VolumesNegativeTest-623906826 tempest-VolumesNegativeTest-623906826-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.008581 Apr 23 03:45:53 user devstack@n-api.service[61308]: [pid: 61308|app: 0|req: 17/51] 10.0.0.210 () {62 vars in 1214 bytes} [Sun Apr 23 03:45:53 2023] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 10 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Apr 23 03:45:53 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi [None req-6554d923-981a-4712-a651-e45e486f68e2 tempest-VolumesNegativeTest-623906826 tempest-VolumesNegativeTest-623906826-project-member] Calling method '.version_select at 0x7f21e1d0c790>' {{(pid=61306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 03:45:54 user devstack@n-api.service[61306]: INFO nova.api.openstack.wsgi [None req-6554d923-981a-4712-a651-e45e486f68e2 tempest-VolumesNegativeTest-623906826 tempest-VolumesNegativeTest-623906826-project-member] HTTP exception thrown: Volume d1b1499a-6d5a-4091-ba63-3810228c97ca could not be found. Apr 23 03:45:54 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi [None req-6554d923-981a-4712-a651-e45e486f68e2 tempest-VolumesNegativeTest-623906826 tempest-VolumesNegativeTest-623906826-project-member] Request method failure captured: Apr 23 03:45:54 user devstack@n-api.service[61306]: request: DELETE /compute/v2.1/os-volumes/d1b1499a-6d5a-4091-ba63-3810228c97ca HTTP/1.1 Apr 23 03:45:54 user devstack@n-api.service[61306]: Accept: application/json Apr 23 03:45:54 user devstack@n-api.service[61306]: Accept-Encoding: identity Apr 23 03:45:54 user devstack@n-api.service[61306]: Connection: close Apr 23 03:45:54 user devstack@n-api.service[61306]: Content-Length: 0 Apr 23 03:45:54 user devstack@n-api.service[61306]: Content-Type: application/json Apr 23 03:45:54 user devstack@n-api.service[61306]: Host: 10.0.0.210 Apr 23 03:45:54 user devstack@n-api.service[61306]: Openstack-System-Scope: None Apr 23 03:45:54 user devstack@n-api.service[61306]: User-Agent: python-urllib3/1.26.15 Apr 23 03:45:54 user devstack@n-api.service[61306]: X-Auth-Token: gAAAAABkRKnwBvZ7XOMMliNdysMtpwgZ7OmNzO2vhKR5IhbhH5yUyLWzK8W_enMFC1zKYvgqD-GphGfCMF_mBgb3GxY29y2lKycwaUs0l332l3i1GWghDCZhwtDo_zmzOISpYZcYnJnIj0NcuGvM6RKTp8Scx72B9Ey9pKo_3C0KCuK6oABI7OY Apr 23 03:45:54 user devstack@n-api.service[61306]: X-Domain-Id: None Apr 23 03:45:54 user devstack@n-api.service[61306]: X-Domain-Name: None Apr 23 03:45:54 user devstack@n-api.service[61306]: X-Identity-Status: Confirmed Apr 23 03:45:54 user devstack@n-api.service[61306]: X-Is-Admin-Project: True Apr 23 03:45:54 user devstack@n-api.service[61306]: X-Project-Domain-Id: default Apr 23 03:45:54 user devstack@n-api.service[61306]: X-Project-Domain-Name: Default Apr 23 03:45:54 user devstack@n-api.service[61306]: X-Project-Id: 509c77b91a5c439d8151b9eac5b9e920 Apr 23 03:45:54 user devstack@n-api.service[61306]: X-Project-Name: tempest-VolumesNegativeTest-623906826 Apr 23 03:45:54 user devstack@n-api.service[61306]: X-Role: reader,member Apr 23 03:45:54 user devstack@n-api.service[61306]: X-Roles: reader,member Apr 23 03:45:54 user devstack@n-api.service[61306]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/509c77b91a5c439d8151b9eac5b9e920"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/509c77b91a5c439d8151b9eac5b9e920"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/509c77b91a5c439d8151b9eac5b9e920"}]}] Apr 23 03:45:54 user devstack@n-api.service[61306]: X-Tenant: tempest-VolumesNegativeTest-623906826 Apr 23 03:45:54 user devstack@n-api.service[61306]: X-Tenant-Id: 509c77b91a5c439d8151b9eac5b9e920 Apr 23 03:45:54 user devstack@n-api.service[61306]: X-Tenant-Name: tempest-VolumesNegativeTest-623906826 Apr 23 03:45:54 user devstack@n-api.service[61306]: X-User: tempest-VolumesNegativeTest-623906826-project-member Apr 23 03:45:54 user devstack@n-api.service[61306]: X-User-Domain-Id: default Apr 23 03:45:54 user devstack@n-api.service[61306]: X-User-Domain-Name: Default Apr 23 03:45:54 user devstack@n-api.service[61306]: X-User-Id: ff936c80d08f44b392b07257d09d53a3 Apr 23 03:45:54 user devstack@n-api.service[61306]: X-User-Name: tempest-VolumesNegativeTest-623906826-project-member Apr 23 03:45:54 user devstack@n-api.service[61306]: method: Apr 23 03:45:54 user devstack@n-api.service[61306]: exception: Volume d1b1499a-6d5a-4091-ba63-3810228c97ca could not be found. Apr 23 03:45:54 user devstack@n-api.service[61306]: action_args: {'id': 'd1b1499a-6d5a-4091-ba63-3810228c97ca'} Apr 23 03:45:54 user devstack@n-api.service[61306]: {{(pid=61306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 23 03:45:54 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 23 03:45:54 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 23 03:45:54 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 23 03:45:54 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 23 03:45:54 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 23 03:45:54 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 23 03:45:54 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 23 03:45:54 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 23 03:45:54 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 23 03:45:54 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 23 03:45:54 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 23 03:45:54 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 23 03:45:54 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 23 03:45:54 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 23 03:45:54 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 23 03:45:54 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d1b1499a-6d5a-4091-ba63-3810228c97ca could not be found. (HTTP 404) (Request-ID: req-b6c2facd-b1f8-4e8d-8765-7a9737ae56bc) Apr 23 03:45:54 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi Apr 23 03:45:54 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 23 03:45:54 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi Apr 23 03:45:54 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 23 03:45:54 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Apr 23 03:45:54 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Apr 23 03:45:54 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 23 03:45:54 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 23 03:45:54 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 23 03:45:54 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 23 03:45:54 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 23 03:45:54 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 23 03:45:54 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 23 03:45:54 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 23 03:45:54 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 23 03:45:54 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 23 03:45:54 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 23 03:45:54 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 23 03:45:54 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 23 03:45:54 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 23 03:45:54 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 23 03:45:54 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 23 03:45:54 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 23 03:45:54 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 23 03:45:54 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 23 03:45:54 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 23 03:45:54 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d1b1499a-6d5a-4091-ba63-3810228c97ca could not be found. Apr 23 03:45:54 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi Apr 23 03:45:54 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 23 03:45:54 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi Apr 23 03:45:54 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 23 03:45:54 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 23 03:45:54 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 23 03:45:54 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 23 03:45:54 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 23 03:45:54 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 23 03:45:54 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 23 03:45:54 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 23 03:45:54 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 23 03:45:54 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Apr 23 03:45:54 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 23 03:45:54 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d1b1499a-6d5a-4091-ba63-3810228c97ca could not be found. Apr 23 03:45:54 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi Apr 23 03:45:54 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 23 03:45:54 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi Apr 23 03:45:54 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 23 03:45:54 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 23 03:45:54 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 23 03:45:54 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 23 03:45:54 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 23 03:45:54 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d1b1499a-6d5a-4091-ba63-3810228c97ca could not be found. Apr 23 03:45:54 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi Apr 23 03:45:54 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi [None req-6554d923-981a-4712-a651-e45e486f68e2 tempest-VolumesNegativeTest-623906826 tempest-VolumesNegativeTest-623906826-project-member] Returning 404 to user: Volume d1b1499a-6d5a-4091-ba63-3810228c97ca could not be found. {{(pid=61306) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 23 03:45:54 user devstack@n-api.service[61306]: INFO nova.api.openstack.requestlog [None req-6554d923-981a-4712-a651-e45e486f68e2 tempest-VolumesNegativeTest-623906826 tempest-VolumesNegativeTest-623906826-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/d1b1499a-6d5a-4091-ba63-3810228c97ca" status: 404 len: 109 microversion: 2.1 time: 0.788743 Apr 23 03:45:54 user devstack@n-api.service[61306]: [pid: 61306|app: 0|req: 17/52] 10.0.0.210 () {62 vars in 1325 bytes} [Sun Apr 23 03:45:53 2023] DELETE /compute/v2.1/os-volumes/d1b1499a-6d5a-4091-ba63-3810228c97ca => generated 109 bytes in 790 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 23 03:45:54 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi [None req-33029acb-2923-471f-b9b4-81928de111df tempest-VolumesNegativeTest-623906826 tempest-VolumesNegativeTest-623906826-project-member] Calling method '.version_select at 0x7f21e1f73a30>' {{(pid=61307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 03:45:55 user devstack@n-api.service[61307]: INFO nova.api.openstack.wsgi [None req-33029acb-2923-471f-b9b4-81928de111df tempest-VolumesNegativeTest-623906826 tempest-VolumesNegativeTest-623906826-project-member] HTTP exception thrown: Volume 59a4db98-a887-41eb-ad28-b90345adce1f could not be found. Apr 23 03:45:55 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi [None req-33029acb-2923-471f-b9b4-81928de111df tempest-VolumesNegativeTest-623906826 tempest-VolumesNegativeTest-623906826-project-member] Request method failure captured: Apr 23 03:45:55 user devstack@n-api.service[61307]: request: GET /compute/v2.1/os-volumes/59a4db98-a887-41eb-ad28-b90345adce1f HTTP/1.1 Apr 23 03:45:55 user devstack@n-api.service[61307]: Accept: application/json Apr 23 03:45:55 user devstack@n-api.service[61307]: Accept-Encoding: identity Apr 23 03:45:55 user devstack@n-api.service[61307]: Connection: close Apr 23 03:45:55 user devstack@n-api.service[61307]: Content-Length: 0 Apr 23 03:45:55 user devstack@n-api.service[61307]: Content-Type: application/json Apr 23 03:45:55 user devstack@n-api.service[61307]: Host: 10.0.0.210 Apr 23 03:45:55 user devstack@n-api.service[61307]: Openstack-System-Scope: None Apr 23 03:45:55 user devstack@n-api.service[61307]: User-Agent: python-urllib3/1.26.15 Apr 23 03:45:55 user devstack@n-api.service[61307]: X-Auth-Token: gAAAAABkRKnwBvZ7XOMMliNdysMtpwgZ7OmNzO2vhKR5IhbhH5yUyLWzK8W_enMFC1zKYvgqD-GphGfCMF_mBgb3GxY29y2lKycwaUs0l332l3i1GWghDCZhwtDo_zmzOISpYZcYnJnIj0NcuGvM6RKTp8Scx72B9Ey9pKo_3C0KCuK6oABI7OY Apr 23 03:45:55 user devstack@n-api.service[61307]: X-Domain-Id: None Apr 23 03:45:55 user devstack@n-api.service[61307]: X-Domain-Name: None Apr 23 03:45:55 user devstack@n-api.service[61307]: X-Identity-Status: Confirmed Apr 23 03:45:55 user devstack@n-api.service[61307]: X-Is-Admin-Project: True Apr 23 03:45:55 user devstack@n-api.service[61307]: X-Project-Domain-Id: default Apr 23 03:45:55 user devstack@n-api.service[61307]: X-Project-Domain-Name: Default Apr 23 03:45:55 user devstack@n-api.service[61307]: X-Project-Id: 509c77b91a5c439d8151b9eac5b9e920 Apr 23 03:45:55 user devstack@n-api.service[61307]: X-Project-Name: tempest-VolumesNegativeTest-623906826 Apr 23 03:45:55 user devstack@n-api.service[61307]: X-Role: reader,member Apr 23 03:45:55 user devstack@n-api.service[61307]: X-Roles: reader,member Apr 23 03:45:55 user devstack@n-api.service[61307]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/509c77b91a5c439d8151b9eac5b9e920"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/509c77b91a5c439d8151b9eac5b9e920"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/509c77b91a5c439d8151b9eac5b9e920"}]}] Apr 23 03:45:55 user devstack@n-api.service[61307]: X-Tenant: tempest-VolumesNegativeTest-623906826 Apr 23 03:45:55 user devstack@n-api.service[61307]: X-Tenant-Id: 509c77b91a5c439d8151b9eac5b9e920 Apr 23 03:45:55 user devstack@n-api.service[61307]: X-Tenant-Name: tempest-VolumesNegativeTest-623906826 Apr 23 03:45:55 user devstack@n-api.service[61307]: X-User: tempest-VolumesNegativeTest-623906826-project-member Apr 23 03:45:55 user devstack@n-api.service[61307]: X-User-Domain-Id: default Apr 23 03:45:55 user devstack@n-api.service[61307]: X-User-Domain-Name: Default Apr 23 03:45:55 user devstack@n-api.service[61307]: X-User-Id: ff936c80d08f44b392b07257d09d53a3 Apr 23 03:45:55 user devstack@n-api.service[61307]: X-User-Name: tempest-VolumesNegativeTest-623906826-project-member Apr 23 03:45:55 user devstack@n-api.service[61307]: method: Apr 23 03:45:55 user devstack@n-api.service[61307]: exception: Volume 59a4db98-a887-41eb-ad28-b90345adce1f could not be found. Apr 23 03:45:55 user devstack@n-api.service[61307]: action_args: {'id': '59a4db98-a887-41eb-ad28-b90345adce1f'} Apr 23 03:45:55 user devstack@n-api.service[61307]: {{(pid=61307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 23 03:45:55 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 23 03:45:55 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 23 03:45:55 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 23 03:45:55 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 23 03:45:55 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 23 03:45:55 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 23 03:45:55 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 23 03:45:55 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 23 03:45:55 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 23 03:45:55 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 23 03:45:55 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 23 03:45:55 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 23 03:45:55 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 23 03:45:55 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 23 03:45:55 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 23 03:45:55 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 59a4db98-a887-41eb-ad28-b90345adce1f could not be found. (HTTP 404) (Request-ID: req-4579606f-c5e8-456e-a06f-e3afb2d0daaf) Apr 23 03:45:55 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi Apr 23 03:45:55 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 23 03:45:55 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi Apr 23 03:45:55 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 23 03:45:55 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 23 03:45:55 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 23 03:45:55 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 23 03:45:55 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 23 03:45:55 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 23 03:45:55 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 23 03:45:55 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 23 03:45:55 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 23 03:45:55 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 23 03:45:55 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 23 03:45:55 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 23 03:45:55 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 23 03:45:55 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 23 03:45:55 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 23 03:45:55 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 23 03:45:55 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 23 03:45:55 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 23 03:45:55 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 23 03:45:55 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 23 03:45:55 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 23 03:45:55 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 23 03:45:55 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 23 03:45:55 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 59a4db98-a887-41eb-ad28-b90345adce1f could not be found. Apr 23 03:45:55 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi Apr 23 03:45:55 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 23 03:45:55 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi Apr 23 03:45:55 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 23 03:45:55 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 23 03:45:55 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 23 03:45:55 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 23 03:45:55 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 23 03:45:55 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 23 03:45:55 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 23 03:45:55 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 23 03:45:55 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 23 03:45:55 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 23 03:45:55 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 23 03:45:55 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 59a4db98-a887-41eb-ad28-b90345adce1f could not be found. Apr 23 03:45:55 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi Apr 23 03:45:55 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 23 03:45:55 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi Apr 23 03:45:55 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 23 03:45:55 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 23 03:45:55 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 23 03:45:55 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 23 03:45:55 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 23 03:45:55 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 59a4db98-a887-41eb-ad28-b90345adce1f could not be found. Apr 23 03:45:55 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi Apr 23 03:45:55 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi [None req-33029acb-2923-471f-b9b4-81928de111df tempest-VolumesNegativeTest-623906826 tempest-VolumesNegativeTest-623906826-project-member] Returning 404 to user: Volume 59a4db98-a887-41eb-ad28-b90345adce1f could not be found. {{(pid=61307) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 23 03:45:55 user devstack@n-api.service[61307]: INFO nova.api.openstack.requestlog [None req-33029acb-2923-471f-b9b4-81928de111df tempest-VolumesNegativeTest-623906826 tempest-VolumesNegativeTest-623906826-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/59a4db98-a887-41eb-ad28-b90345adce1f" status: 404 len: 109 microversion: 2.1 time: 0.273890 Apr 23 03:45:55 user devstack@n-api.service[61307]: [pid: 61307|app: 0|req: 19/53] 10.0.0.210 () {62 vars in 1322 bytes} [Sun Apr 23 03:45:54 2023] GET /compute/v2.1/os-volumes/59a4db98-a887-41eb-ad28-b90345adce1f => generated 109 bytes in 276 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 23 03:46:06 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi [None req-babcb3c7-25f5-4803-b036-a11f02c5e651 tempest-ServerStableDeviceRescueTest-847110386 tempest-ServerStableDeviceRescueTest-847110386-project-member] Action: 'create', calling method: .version_select at 0x7f21e215b880>, body: {"keypair": {"name": "tempest-keypair-884305512", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJloyUtsCDIs9T1+8g/hMHz6r8pR2SR9PggBoD/KR0LjhZoNK/nEt54tYO6knV7E+845Tt0p37M8EMNHSd7z4jcysmifK+fuISVR4KNyRapKSmK+MZDTAfLCZ5mhzyFU5A=="}} {{(pid=61308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 03:46:06 user devstack@n-api.service[61308]: DEBUG nova.quota [None req-babcb3c7-25f5-4803-b036-a11f02c5e651 tempest-ServerStableDeviceRescueTest-847110386 tempest-ServerStableDeviceRescueTest-847110386-project-member] Getting quotas for project 5864626fffa7443c800b244471966d65. Resources: {'key_pairs'} {{(pid=61308) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 23 03:46:06 user devstack@n-api.service[61308]: DEBUG nova.quota [None req-babcb3c7-25f5-4803-b036-a11f02c5e651 tempest-ServerStableDeviceRescueTest-847110386 tempest-ServerStableDeviceRescueTest-847110386-project-member] Getting quotas for user 3311b6ae249f41269fde041f6e441840 and project 5864626fffa7443c800b244471966d65. Resources: {'key_pairs'} {{(pid=61308) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 23 03:46:06 user devstack@n-api.service[61308]: INFO nova.api.openstack.requestlog [None req-babcb3c7-25f5-4803-b036-a11f02c5e651 tempest-ServerStableDeviceRescueTest-847110386 tempest-ServerStableDeviceRescueTest-847110386-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.290332 Apr 23 03:46:06 user devstack@n-api.service[61308]: [pid: 61308|app: 0|req: 18/54] 10.0.0.210 () {64 vars in 1236 bytes} [Sun Apr 23 03:46:05 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 23 03:46:10 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi [None req-d9e54769-2452-484c-b0e2-f633607bb3bf tempest-DeleteServersTestJSON-2062396414 tempest-DeleteServersTestJSON-2062396414-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1138104", "imageRef": "e6127373-9931-4277-9458-eceef653ea1e", "flavorRef": "42", "networks": [{"uuid": "47db66e9-5162-4031-9d71-5e13c16ee002"}]}} {{(pid=61306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 03:46:11 user devstack@n-api.service[61306]: DEBUG nova.network.neutron [None req-d9e54769-2452-484c-b0e2-f633607bb3bf tempest-DeleteServersTestJSON-2062396414 tempest-DeleteServersTestJSON-2062396414-project-member] validate_networks() for [('47db66e9-5162-4031-9d71-5e13c16ee002', None, None, None, None, None)] {{(pid=61306) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 23 03:46:12 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi [None req-bfdfc11f-4e95-4357-ba10-63a44016b430 tempest-ServerStableDeviceRescueTest-847110386 tempest-ServerStableDeviceRescueTest-847110386-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerStableDeviceRescueTest-server-329028935", "imageRef": "e6127373-9931-4277-9458-eceef653ea1e", "flavorRef": "42", "networks": [{"uuid": "2354786d-cb38-48f3-9585-d88f27219024"}], "security_groups": [{"name": "tempest-securitygroup--1291051952"}], "key_name": "tempest-keypair-884305512", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 03:46:12 user devstack@n-api.service[61307]: DEBUG nova.network.neutron [None req-bfdfc11f-4e95-4357-ba10-63a44016b430 tempest-ServerStableDeviceRescueTest-847110386 tempest-ServerStableDeviceRescueTest-847110386-project-member] validate_networks() for [('2354786d-cb38-48f3-9585-d88f27219024', None, None, None, None, None)] {{(pid=61307) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 23 03:46:12 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi [None req-02e54c15-fdc2-42af-baf8-4719307d20c8 tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] Action: 'create', calling method: .version_select at 0x7f21e1e4e830>, body: {"keypair": {"name": "tempest-keypair-1821880172", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAlSA3423uMfFY5jWf8qjLn8fKTUZDZCbWqlOeGrb7q4dIPzzhHHma7J2h5uyB7cueX2lnELTDhfWhiWxlTN0oUzC4mH9t+dt+HV9lsJMmuXTTekJoF4InNO5IUJTfbZHQ=="}} {{(pid=61308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 03:46:12 user devstack@n-api.service[61308]: DEBUG nova.quota [None req-02e54c15-fdc2-42af-baf8-4719307d20c8 tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] Getting quotas for project 70b031ddc5c94ca98e7161de03bda4b7. Resources: {'key_pairs'} {{(pid=61308) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 23 03:46:12 user devstack@n-api.service[61308]: DEBUG nova.quota [None req-02e54c15-fdc2-42af-baf8-4719307d20c8 tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] Getting quotas for user e3d689f1c160478ca83bbff3104d8ec3 and project 70b031ddc5c94ca98e7161de03bda4b7. Resources: {'key_pairs'} {{(pid=61308) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 23 03:46:12 user devstack@n-api.service[61308]: INFO nova.api.openstack.requestlog [None req-02e54c15-fdc2-42af-baf8-4719307d20c8 tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.298156 Apr 23 03:46:12 user devstack@n-api.service[61308]: [pid: 61308|app: 0|req: 19/55] 10.0.0.210 () {64 vars in 1236 bytes} [Sun Apr 23 03:46:12 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 23 03:46:13 user devstack@n-api.service[61306]: DEBUG nova.virt.hardware [None req-d9e54769-2452-484c-b0e2-f633607bb3bf tempest-DeleteServersTestJSON-2062396414 tempest-DeleteServersTestJSON-2062396414-project-member] Flavor limits 0:0:0 {{(pid=61306) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 23 03:46:13 user devstack@n-api.service[61306]: DEBUG nova.virt.hardware [None req-d9e54769-2452-484c-b0e2-f633607bb3bf tempest-DeleteServersTestJSON-2062396414 tempest-DeleteServersTestJSON-2062396414-project-member] Image limits 0:0:0 {{(pid=61306) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 23 03:46:13 user devstack@n-api.service[61306]: DEBUG nova.virt.hardware [None req-d9e54769-2452-484c-b0e2-f633607bb3bf tempest-DeleteServersTestJSON-2062396414 tempest-DeleteServersTestJSON-2062396414-project-member] Flavor pref 0:0:0 {{(pid=61306) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 23 03:46:13 user devstack@n-api.service[61306]: DEBUG nova.virt.hardware [None req-d9e54769-2452-484c-b0e2-f633607bb3bf tempest-DeleteServersTestJSON-2062396414 tempest-DeleteServersTestJSON-2062396414-project-member] Image pref 0:0:0 {{(pid=61306) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 23 03:46:13 user devstack@n-api.service[61306]: DEBUG nova.virt.hardware [None req-d9e54769-2452-484c-b0e2-f633607bb3bf tempest-DeleteServersTestJSON-2062396414 tempest-DeleteServersTestJSON-2062396414-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61306) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 23 03:46:13 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-d9e54769-2452-484c-b0e2-f633607bb3bf tempest-DeleteServersTestJSON-2062396414 tempest-DeleteServersTestJSON-2062396414-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:46:13 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-d9e54769-2452-484c-b0e2-f633607bb3bf tempest-DeleteServersTestJSON-2062396414 tempest-DeleteServersTestJSON-2062396414-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:46:13 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-d9e54769-2452-484c-b0e2-f633607bb3bf tempest-DeleteServersTestJSON-2062396414 tempest-DeleteServersTestJSON-2062396414-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:46:13 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-d9e54769-2452-484c-b0e2-f633607bb3bf tempest-DeleteServersTestJSON-2062396414 tempest-DeleteServersTestJSON-2062396414-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:46:13 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-d9e54769-2452-484c-b0e2-f633607bb3bf tempest-DeleteServersTestJSON-2062396414 tempest-DeleteServersTestJSON-2062396414-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:46:13 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-d9e54769-2452-484c-b0e2-f633607bb3bf tempest-DeleteServersTestJSON-2062396414 tempest-DeleteServersTestJSON-2062396414-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:46:13 user devstack@n-api.service[61306]: DEBUG nova.quota [None req-d9e54769-2452-484c-b0e2-f633607bb3bf tempest-DeleteServersTestJSON-2062396414 tempest-DeleteServersTestJSON-2062396414-project-member] Getting quotas for project c4f91ccdb4da4cb4bc4b55b7ac2189f0. Resources: {'ram', 'instances', 'cores'} {{(pid=61306) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 23 03:46:13 user devstack@n-api.service[61306]: DEBUG nova.quota [None req-d9e54769-2452-484c-b0e2-f633607bb3bf tempest-DeleteServersTestJSON-2062396414 tempest-DeleteServersTestJSON-2062396414-project-member] Getting quotas for user 4e6ddab9797c449d85bf6f3a241473e0 and project c4f91ccdb4da4cb4bc4b55b7ac2189f0. Resources: {'ram', 'instances', 'cores'} {{(pid=61306) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 23 03:46:13 user devstack@n-api.service[61306]: DEBUG nova.compute.api [None req-d9e54769-2452-484c-b0e2-f633607bb3bf tempest-DeleteServersTestJSON-2062396414 tempest-DeleteServersTestJSON-2062396414-project-member] Going to run 1 instances... {{(pid=61306) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 23 03:46:13 user devstack@n-api.service[61306]: DEBUG nova.compute.api [None req-d9e54769-2452-484c-b0e2-f633607bb3bf tempest-DeleteServersTestJSON-2062396414 tempest-DeleteServersTestJSON-2062396414-project-member] [instance: 56d8da41-3e04-465b-a1de-73d9e994682d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e6127373-9931-4277-9458-eceef653ea1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61306) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 23 03:46:13 user devstack@n-api.service[61306]: INFO nova.api.openstack.requestlog [None req-d9e54769-2452-484c-b0e2-f633607bb3bf tempest-DeleteServersTestJSON-2062396414 tempest-DeleteServersTestJSON-2062396414-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 2.584461 Apr 23 03:46:13 user devstack@n-api.service[61306]: [pid: 61306|app: 0|req: 18/56] 10.0.0.210 () {64 vars in 1224 bytes} [Sun Apr 23 03:46:10 2023] POST /compute/v2.1/servers => generated 378 bytes in 2586 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 23 03:46:13 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi [None req-44c20077-e00f-43c4-9ff1-23ee25148a17 tempest-DeleteServersTestJSON-2062396414 tempest-DeleteServersTestJSON-2062396414-project-member] Calling method '>' {{(pid=61308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 03:46:13 user devstack@n-api.service[61308]: DEBUG nova.compute.api [None req-44c20077-e00f-43c4-9ff1-23ee25148a17 tempest-DeleteServersTestJSON-2062396414 tempest-DeleteServersTestJSON-2062396414-project-member] [instance: 56d8da41-3e04-465b-a1de-73d9e994682d] Fetching instance by UUID {{(pid=61308) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 23 03:46:14 user devstack@n-api.service[61308]: DEBUG nova.policy [None req-44c20077-e00f-43c4-9ff1-23ee25148a17 tempest-DeleteServersTestJSON-2062396414 tempest-DeleteServersTestJSON-2062396414-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e6ddab9797c449d85bf6f3a241473e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f91ccdb4da4cb4bc4b55b7ac2189f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61308) authorize /opt/stack/nova/nova/policy.py:203}} Apr 23 03:46:14 user devstack@n-api.service[61308]: INFO nova.api.openstack.requestlog [None req-44c20077-e00f-43c4-9ff1-23ee25148a17 tempest-DeleteServersTestJSON-2062396414 tempest-DeleteServersTestJSON-2062396414-project-member] 10.0.0.210 "GET /compute/v2.1/servers/56d8da41-3e04-465b-a1de-73d9e994682d" status: 200 len: 1206 microversion: 2.1 time: 0.774367 Apr 23 03:46:14 user devstack@n-api.service[61308]: [pid: 61308|app: 0|req: 20/57] 10.0.0.210 () {62 vars in 1313 bytes} [Sun Apr 23 03:46:13 2023] GET /compute/v2.1/servers/56d8da41-3e04-465b-a1de-73d9e994682d => generated 1206 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 23 03:46:14 user devstack@n-api.service[61307]: DEBUG nova.virt.hardware [None req-bfdfc11f-4e95-4357-ba10-63a44016b430 tempest-ServerStableDeviceRescueTest-847110386 tempest-ServerStableDeviceRescueTest-847110386-project-member] Flavor limits 0:0:0 {{(pid=61307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 23 03:46:14 user devstack@n-api.service[61307]: DEBUG nova.virt.hardware [None req-bfdfc11f-4e95-4357-ba10-63a44016b430 tempest-ServerStableDeviceRescueTest-847110386 tempest-ServerStableDeviceRescueTest-847110386-project-member] Image limits 0:0:0 {{(pid=61307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 23 03:46:14 user devstack@n-api.service[61307]: DEBUG nova.virt.hardware [None req-bfdfc11f-4e95-4357-ba10-63a44016b430 tempest-ServerStableDeviceRescueTest-847110386 tempest-ServerStableDeviceRescueTest-847110386-project-member] Flavor pref 0:0:0 {{(pid=61307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 23 03:46:14 user devstack@n-api.service[61307]: DEBUG nova.virt.hardware [None req-bfdfc11f-4e95-4357-ba10-63a44016b430 tempest-ServerStableDeviceRescueTest-847110386 tempest-ServerStableDeviceRescueTest-847110386-project-member] Image pref 0:0:0 {{(pid=61307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 23 03:46:14 user devstack@n-api.service[61307]: DEBUG nova.virt.hardware [None req-bfdfc11f-4e95-4357-ba10-63a44016b430 tempest-ServerStableDeviceRescueTest-847110386 tempest-ServerStableDeviceRescueTest-847110386-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 23 03:46:14 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-bfdfc11f-4e95-4357-ba10-63a44016b430 tempest-ServerStableDeviceRescueTest-847110386 tempest-ServerStableDeviceRescueTest-847110386-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:46:14 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-bfdfc11f-4e95-4357-ba10-63a44016b430 tempest-ServerStableDeviceRescueTest-847110386 tempest-ServerStableDeviceRescueTest-847110386-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:46:14 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-bfdfc11f-4e95-4357-ba10-63a44016b430 tempest-ServerStableDeviceRescueTest-847110386 tempest-ServerStableDeviceRescueTest-847110386-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:46:14 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-bfdfc11f-4e95-4357-ba10-63a44016b430 tempest-ServerStableDeviceRescueTest-847110386 tempest-ServerStableDeviceRescueTest-847110386-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:46:14 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-bfdfc11f-4e95-4357-ba10-63a44016b430 tempest-ServerStableDeviceRescueTest-847110386 tempest-ServerStableDeviceRescueTest-847110386-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:46:14 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-bfdfc11f-4e95-4357-ba10-63a44016b430 tempest-ServerStableDeviceRescueTest-847110386 tempest-ServerStableDeviceRescueTest-847110386-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:46:14 user devstack@n-api.service[61307]: DEBUG nova.quota [None req-bfdfc11f-4e95-4357-ba10-63a44016b430 tempest-ServerStableDeviceRescueTest-847110386 tempest-ServerStableDeviceRescueTest-847110386-project-member] Getting quotas for project 5864626fffa7443c800b244471966d65. Resources: {'ram', 'instances', 'cores'} {{(pid=61307) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 23 03:46:14 user devstack@n-api.service[61307]: DEBUG nova.quota [None req-bfdfc11f-4e95-4357-ba10-63a44016b430 tempest-ServerStableDeviceRescueTest-847110386 tempest-ServerStableDeviceRescueTest-847110386-project-member] Getting quotas for user 3311b6ae249f41269fde041f6e441840 and project 5864626fffa7443c800b244471966d65. Resources: {'ram', 'instances', 'cores'} {{(pid=61307) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 23 03:46:14 user devstack@n-api.service[61307]: DEBUG nova.compute.api [None req-bfdfc11f-4e95-4357-ba10-63a44016b430 tempest-ServerStableDeviceRescueTest-847110386 tempest-ServerStableDeviceRescueTest-847110386-project-member] Going to run 1 instances... {{(pid=61307) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 23 03:46:14 user devstack@n-api.service[61307]: DEBUG nova.compute.api [None req-bfdfc11f-4e95-4357-ba10-63a44016b430 tempest-ServerStableDeviceRescueTest-847110386 tempest-ServerStableDeviceRescueTest-847110386-project-member] [instance: f279f3d3-581d-4d6f-924f-4104ec23832a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e6127373-9931-4277-9458-eceef653ea1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61307) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 23 03:46:14 user devstack@n-api.service[61307]: INFO nova.api.openstack.requestlog [None req-bfdfc11f-4e95-4357-ba10-63a44016b430 tempest-ServerStableDeviceRescueTest-847110386 tempest-ServerStableDeviceRescueTest-847110386-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 2.255850 Apr 23 03:46:14 user devstack@n-api.service[61307]: [pid: 61307|app: 0|req: 20/58] 10.0.0.210 () {64 vars in 1224 bytes} [Sun Apr 23 03:46:12 2023] POST /compute/v2.1/servers => generated 404 bytes in 2257 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 23 03:46:14 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi [None req-7eadfa7f-8e74-4f46-97b5-6fb6f3afacab tempest-ServerStableDeviceRescueTest-847110386 tempest-ServerStableDeviceRescueTest-847110386-project-member] Calling method '>' {{(pid=61306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 03:46:14 user devstack@n-api.service[61306]: DEBUG nova.compute.api [None req-7eadfa7f-8e74-4f46-97b5-6fb6f3afacab tempest-ServerStableDeviceRescueTest-847110386 tempest-ServerStableDeviceRescueTest-847110386-project-member] [instance: f279f3d3-581d-4d6f-924f-4104ec23832a] Fetching instance by UUID {{(pid=61306) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 23 03:46:14 user devstack@n-api.service[61306]: DEBUG nova.policy [None req-7eadfa7f-8e74-4f46-97b5-6fb6f3afacab tempest-ServerStableDeviceRescueTest-847110386 tempest-ServerStableDeviceRescueTest-847110386-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3311b6ae249f41269fde041f6e441840', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5864626fffa7443c800b244471966d65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61306) authorize /opt/stack/nova/nova/policy.py:203}} Apr 23 03:46:14 user devstack@n-api.service[61306]: INFO nova.api.openstack.requestlog [None req-7eadfa7f-8e74-4f46-97b5-6fb6f3afacab tempest-ServerStableDeviceRescueTest-847110386 tempest-ServerStableDeviceRescueTest-847110386-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f279f3d3-581d-4d6f-924f-4104ec23832a" status: 200 len: 1238 microversion: 2.1 time: 0.142071 Apr 23 03:46:14 user devstack@n-api.service[61306]: [pid: 61306|app: 0|req: 19/59] 10.0.0.210 () {62 vars in 1313 bytes} [Sun Apr 23 03:46:14 2023] GET /compute/v2.1/servers/f279f3d3-581d-4d6f-924f-4104ec23832a => generated 1238 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 23 03:46:20 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi [None req-c76bc28a-f9bd-476f-8654-c91343a03b52 tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1420796136", "imageRef": "e6127373-9931-4277-9458-eceef653ea1e", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "5604c946-dd68-4517-9c39-b4d33d86a345"}], "security_groups": [{"name": "tempest-securitygroup--126066106"}], "key_name": "tempest-keypair-1821880172", "user_data": "}} {{(pid=61308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 03:46:20 user devstack@n-api.service[61308]: DEBUG nova.network.neutron [None req-c76bc28a-f9bd-476f-8654-c91343a03b52 tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] validate_networks() for [('5604c946-dd68-4517-9c39-b4d33d86a345', None, None, None, None, None)] {{(pid=61308) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 23 03:46:21 user devstack@n-api.service[61308]: DEBUG nova.virt.hardware [None req-c76bc28a-f9bd-476f-8654-c91343a03b52 tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] Flavor limits 0:0:0 {{(pid=61308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 23 03:46:21 user devstack@n-api.service[61308]: DEBUG nova.virt.hardware [None req-c76bc28a-f9bd-476f-8654-c91343a03b52 tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] Image limits 0:0:0 {{(pid=61308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 23 03:46:21 user devstack@n-api.service[61308]: DEBUG nova.virt.hardware [None req-c76bc28a-f9bd-476f-8654-c91343a03b52 tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] Flavor pref 0:0:0 {{(pid=61308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 23 03:46:21 user devstack@n-api.service[61308]: DEBUG nova.virt.hardware [None req-c76bc28a-f9bd-476f-8654-c91343a03b52 tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] Image pref 0:0:0 {{(pid=61308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 23 03:46:21 user devstack@n-api.service[61308]: DEBUG nova.virt.hardware [None req-c76bc28a-f9bd-476f-8654-c91343a03b52 tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 23 03:46:21 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-c76bc28a-f9bd-476f-8654-c91343a03b52 tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:46:21 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-c76bc28a-f9bd-476f-8654-c91343a03b52 tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:46:21 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-c76bc28a-f9bd-476f-8654-c91343a03b52 tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:46:21 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-c76bc28a-f9bd-476f-8654-c91343a03b52 tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:46:21 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-c76bc28a-f9bd-476f-8654-c91343a03b52 tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:46:21 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-c76bc28a-f9bd-476f-8654-c91343a03b52 tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:46:21 user devstack@n-api.service[61308]: DEBUG nova.quota [None req-c76bc28a-f9bd-476f-8654-c91343a03b52 tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] Getting quotas for project 70b031ddc5c94ca98e7161de03bda4b7. Resources: {'ram', 'instances', 'cores'} {{(pid=61308) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 23 03:46:21 user devstack@n-api.service[61308]: DEBUG nova.quota [None req-c76bc28a-f9bd-476f-8654-c91343a03b52 tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] Getting quotas for user e3d689f1c160478ca83bbff3104d8ec3 and project 70b031ddc5c94ca98e7161de03bda4b7. Resources: {'ram', 'instances', 'cores'} {{(pid=61308) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 23 03:46:21 user devstack@n-api.service[61308]: DEBUG nova.compute.api [None req-c76bc28a-f9bd-476f-8654-c91343a03b52 tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] Going to run 1 instances... {{(pid=61308) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 23 03:46:21 user devstack@n-api.service[61308]: DEBUG nova.compute.api [None req-c76bc28a-f9bd-476f-8654-c91343a03b52 tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] [instance: 08d906c5-1698-4c17-8430-c98f10836398] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e6127373-9931-4277-9458-eceef653ea1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61308) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 23 03:46:21 user devstack@n-api.service[61308]: INFO nova.api.openstack.requestlog [None req-c76bc28a-f9bd-476f-8654-c91343a03b52 tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 1.791707 Apr 23 03:46:21 user devstack@n-api.service[61308]: [pid: 61308|app: 0|req: 21/60] 10.0.0.210 () {64 vars in 1224 bytes} [Sun Apr 23 03:46:20 2023] POST /compute/v2.1/servers => generated 399 bytes in 1794 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 23 03:46:21 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi [None req-ed13c685-59bc-4706-94f0-83579c95ba37 tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] Calling method '>' {{(pid=61307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 03:46:21 user devstack@n-api.service[61307]: DEBUG nova.compute.api [None req-ed13c685-59bc-4706-94f0-83579c95ba37 tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] [instance: 08d906c5-1698-4c17-8430-c98f10836398] Fetching instance by UUID {{(pid=61307) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 23 03:46:22 user devstack@n-api.service[61307]: DEBUG nova.policy [None req-ed13c685-59bc-4706-94f0-83579c95ba37 tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d689f1c160478ca83bbff3104d8ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b031ddc5c94ca98e7161de03bda4b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61307) authorize /opt/stack/nova/nova/policy.py:203}} Apr 23 03:46:22 user devstack@n-api.service[61307]: INFO nova.api.openstack.requestlog [None req-ed13c685-59bc-4706-94f0-83579c95ba37 tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] 10.0.0.210 "GET /compute/v2.1/servers/08d906c5-1698-4c17-8430-c98f10836398" status: 200 len: 1232 microversion: 2.1 time: 0.131601 Apr 23 03:46:22 user devstack@n-api.service[61307]: [pid: 61307|app: 0|req: 21/61] 10.0.0.210 () {62 vars in 1313 bytes} [Sun Apr 23 03:46:21 2023] GET /compute/v2.1/servers/08d906c5-1698-4c17-8430-c98f10836398 => generated 1232 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 23 03:46:25 user devstack@n-api.service[61306]: DEBUG dbcounter [-] [61306] Writing DB stats nova_cell0:SELECT=2 {{(pid=61306) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:46:25 user devstack@n-api.service[61306]: DEBUG dbcounter [-] [61306] Writing DB stats nova_cell1:SELECT=2 {{(pid=61306) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:46:25 user devstack@n-api.service[61306]: DEBUG dbcounter [-] [61306] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=3 {{(pid=61306) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:46:25 user devstack@n-api.service[61306]: DEBUG dbcounter [-] [61306] Writing DB stats nova_cell0:SELECT=8 {{(pid=61306) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:46:25 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi [req-424119bd-0262-4556-b0d5-3aa8745b50d7 req-4b8b3802-21b4-4360-8282-87acf87839eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "56d8da41-3e04-465b-a1de-73d9e994682d", "tag": "552bc11e-f01b-4ee4-94e0-64ab1e19ad9e"}]} {{(pid=61306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 03:46:25 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [req-424119bd-0262-4556-b0d5-3aa8745b50d7 req-4b8b3802-21b4-4360-8282-87acf87839eb service nova] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:46:25 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [req-424119bd-0262-4556-b0d5-3aa8745b50d7 req-4b8b3802-21b4-4360-8282-87acf87839eb service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:46:25 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [req-424119bd-0262-4556-b0d5-3aa8745b50d7 req-4b8b3802-21b4-4360-8282-87acf87839eb service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:46:25 user devstack@n-api.service[61306]: INFO nova.api.openstack.compute.server_external_events [req-424119bd-0262-4556-b0d5-3aa8745b50d7 req-4b8b3802-21b4-4360-8282-87acf87839eb service nova] Creating event network-changed:552bc11e-f01b-4ee4-94e0-64ab1e19ad9e for instance 56d8da41-3e04-465b-a1de-73d9e994682d on user Apr 23 03:46:25 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [req-424119bd-0262-4556-b0d5-3aa8745b50d7 req-4b8b3802-21b4-4360-8282-87acf87839eb service nova] Acquiring lock "compute-rpcapi-router" {{(pid=61306) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 23 03:46:25 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [req-424119bd-0262-4556-b0d5-3aa8745b50d7 req-4b8b3802-21b4-4360-8282-87acf87839eb service nova] Acquired lock "compute-rpcapi-router" {{(pid=61306) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} Apr 23 03:46:25 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-a0a69125-8f51-404a-8ab0-8e16c4d32b9e None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:46:25 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-a0a69125-8f51-404a-8ab0-8e16c4d32b9e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:46:25 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-a0a69125-8f51-404a-8ab0-8e16c4d32b9e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:46:25 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-a0a69125-8f51-404a-8ab0-8e16c4d32b9e None None] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:46:25 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-a0a69125-8f51-404a-8ab0-8e16c4d32b9e None None] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:46:25 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-a0a69125-8f51-404a-8ab0-8e16c4d32b9e None None] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:46:25 user devstack@n-api.service[61306]: INFO nova.compute.rpcapi [None req-a0a69125-8f51-404a-8ab0-8e16c4d32b9e None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Apr 23 03:46:25 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-a0a69125-8f51-404a-8ab0-8e16c4d32b9e None None] Releasing lock "compute-rpcapi-router" {{(pid=61306) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} Apr 23 03:46:25 user devstack@n-api.service[61306]: INFO nova.api.openstack.requestlog [None req-a0a69125-8f51-404a-8ab0-8e16c4d32b9e None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.176433 Apr 23 03:46:25 user devstack@n-api.service[61306]: [pid: 61306|app: 0|req: 20/62] 10.0.0.210 () {68 vars in 1394 bytes} [Sun Apr 23 03:46:25 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 23 03:46:27 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi [req-239e0da9-64f5-41de-888b-13b57acd0a10 req-f2ca9480-a081-4d09-9bbd-24568775b160 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f279f3d3-581d-4d6f-924f-4104ec23832a", "tag": "680802e3-0304-496f-927b-855e4167272b"}]} {{(pid=61308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 03:46:27 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [req-239e0da9-64f5-41de-888b-13b57acd0a10 req-f2ca9480-a081-4d09-9bbd-24568775b160 service nova] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:46:27 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [req-239e0da9-64f5-41de-888b-13b57acd0a10 req-f2ca9480-a081-4d09-9bbd-24568775b160 service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:46:27 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [req-239e0da9-64f5-41de-888b-13b57acd0a10 req-f2ca9480-a081-4d09-9bbd-24568775b160 service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:46:27 user devstack@n-api.service[61308]: INFO nova.api.openstack.compute.server_external_events [req-239e0da9-64f5-41de-888b-13b57acd0a10 req-f2ca9480-a081-4d09-9bbd-24568775b160 service nova] Creating event network-changed:680802e3-0304-496f-927b-855e4167272b for instance f279f3d3-581d-4d6f-924f-4104ec23832a on user Apr 23 03:46:27 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [req-239e0da9-64f5-41de-888b-13b57acd0a10 req-f2ca9480-a081-4d09-9bbd-24568775b160 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=61308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 23 03:46:27 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [req-239e0da9-64f5-41de-888b-13b57acd0a10 req-f2ca9480-a081-4d09-9bbd-24568775b160 service nova] Acquired lock "compute-rpcapi-router" {{(pid=61308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} Apr 23 03:46:27 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-19b0be1e-1981-4fee-8351-34e8bc4f6c91 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:46:27 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-19b0be1e-1981-4fee-8351-34e8bc4f6c91 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:46:27 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-19b0be1e-1981-4fee-8351-34e8bc4f6c91 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:46:27 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-19b0be1e-1981-4fee-8351-34e8bc4f6c91 None None] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:46:27 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-19b0be1e-1981-4fee-8351-34e8bc4f6c91 None None] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:46:27 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-19b0be1e-1981-4fee-8351-34e8bc4f6c91 None None] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:46:27 user devstack@n-api.service[61308]: INFO nova.compute.rpcapi [None req-19b0be1e-1981-4fee-8351-34e8bc4f6c91 None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Apr 23 03:46:27 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-19b0be1e-1981-4fee-8351-34e8bc4f6c91 None None] Releasing lock "compute-rpcapi-router" {{(pid=61308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} Apr 23 03:46:27 user devstack@n-api.service[61308]: INFO nova.api.openstack.requestlog [None req-19b0be1e-1981-4fee-8351-34e8bc4f6c91 None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089744 Apr 23 03:46:27 user devstack@n-api.service[61308]: [pid: 61308|app: 0|req: 22/63] 10.0.0.210 () {68 vars in 1394 bytes} [Sun Apr 23 03:46:27 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 23 03:46:29 user devstack@n-api.service[61307]: DEBUG dbcounter [-] [61307] Writing DB stats nova_cell0:SELECT=2 {{(pid=61307) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:46:29 user devstack@n-api.service[61307]: DEBUG dbcounter [-] [61307] Writing DB stats nova_cell1:SELECT=2 {{(pid=61307) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:46:29 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi [req-4d9ceb06-224f-4709-bfcf-0aff0134daf6 req-cf841a3d-bc2a-45d8-be74-2f2e225465ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08d906c5-1698-4c17-8430-c98f10836398", "tag": "71dae390-2e66-4961-8ce7-1b8fff845732"}]} {{(pid=61307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 03:46:29 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [req-4d9ceb06-224f-4709-bfcf-0aff0134daf6 req-cf841a3d-bc2a-45d8-be74-2f2e225465ea service nova] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:46:29 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [req-4d9ceb06-224f-4709-bfcf-0aff0134daf6 req-cf841a3d-bc2a-45d8-be74-2f2e225465ea service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:46:29 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [req-4d9ceb06-224f-4709-bfcf-0aff0134daf6 req-cf841a3d-bc2a-45d8-be74-2f2e225465ea service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:46:29 user devstack@n-api.service[61307]: INFO nova.api.openstack.compute.server_external_events [req-4d9ceb06-224f-4709-bfcf-0aff0134daf6 req-cf841a3d-bc2a-45d8-be74-2f2e225465ea service nova] Creating event network-changed:71dae390-2e66-4961-8ce7-1b8fff845732 for instance 08d906c5-1698-4c17-8430-c98f10836398 on user Apr 23 03:46:29 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [req-4d9ceb06-224f-4709-bfcf-0aff0134daf6 req-cf841a3d-bc2a-45d8-be74-2f2e225465ea service nova] Acquiring lock "compute-rpcapi-router" {{(pid=61307) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 23 03:46:29 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [req-4d9ceb06-224f-4709-bfcf-0aff0134daf6 req-cf841a3d-bc2a-45d8-be74-2f2e225465ea service nova] Acquired lock "compute-rpcapi-router" {{(pid=61307) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} Apr 23 03:46:29 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-bfb15513-c301-4401-8283-6e2182efd9b4 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:46:29 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-bfb15513-c301-4401-8283-6e2182efd9b4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:46:29 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-bfb15513-c301-4401-8283-6e2182efd9b4 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:46:29 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-bfb15513-c301-4401-8283-6e2182efd9b4 None None] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:46:29 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-bfb15513-c301-4401-8283-6e2182efd9b4 None None] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:46:29 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-bfb15513-c301-4401-8283-6e2182efd9b4 None None] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:46:29 user devstack@n-api.service[61307]: INFO nova.compute.rpcapi [None req-bfb15513-c301-4401-8283-6e2182efd9b4 None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Apr 23 03:46:29 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-bfb15513-c301-4401-8283-6e2182efd9b4 None None] Releasing lock "compute-rpcapi-router" {{(pid=61307) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} Apr 23 03:46:29 user devstack@n-api.service[61307]: INFO nova.api.openstack.requestlog [None req-bfb15513-c301-4401-8283-6e2182efd9b4 None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.242791 Apr 23 03:46:29 user devstack@n-api.service[61307]: [pid: 61307|app: 0|req: 22/64] 10.0.0.210 () {68 vars in 1394 bytes} [Sun Apr 23 03:46:29 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 23 03:46:33 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi [req-afc4795a-692a-4c50-abbb-cab9621d65cf req-403b38f6-9dda-42c0-b80e-a0ab0b6f1187 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56d8da41-3e04-465b-a1de-73d9e994682d", "name": "network-vif-plugged", "status": "completed", "tag": "552bc11e-f01b-4ee4-94e0-64ab1e19ad9e"}]} {{(pid=61306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 03:46:33 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [req-afc4795a-692a-4c50-abbb-cab9621d65cf req-403b38f6-9dda-42c0-b80e-a0ab0b6f1187 service nova] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:46:33 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [req-afc4795a-692a-4c50-abbb-cab9621d65cf req-403b38f6-9dda-42c0-b80e-a0ab0b6f1187 service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:46:33 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [req-afc4795a-692a-4c50-abbb-cab9621d65cf req-403b38f6-9dda-42c0-b80e-a0ab0b6f1187 service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:46:33 user devstack@n-api.service[61306]: INFO nova.api.openstack.compute.server_external_events [req-afc4795a-692a-4c50-abbb-cab9621d65cf req-403b38f6-9dda-42c0-b80e-a0ab0b6f1187 service nova] Creating event network-vif-plugged:552bc11e-f01b-4ee4-94e0-64ab1e19ad9e for instance 56d8da41-3e04-465b-a1de-73d9e994682d on user Apr 23 03:46:33 user devstack@n-api.service[61306]: INFO nova.api.openstack.requestlog [req-afc4795a-692a-4c50-abbb-cab9621d65cf req-403b38f6-9dda-42c0-b80e-a0ab0b6f1187 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115395 Apr 23 03:46:33 user devstack@n-api.service[61306]: [pid: 61306|app: 0|req: 21/65] 10.0.0.210 () {68 vars in 1394 bytes} [Sun Apr 23 03:46:33 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 23 03:46:33 user devstack@n-api.service[61308]: DEBUG dbcounter [-] [61308] Writing DB stats nova_cell0:SELECT=16 {{(pid=61308) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:46:33 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi [req-4dd87f11-a6b4-4b49-9a31-0365e5bc166e req-d36a7420-cbb9-47e6-8e7a-6c3c22c4b605 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f279f3d3-581d-4d6f-924f-4104ec23832a", "name": "network-vif-plugged", "status": "completed", "tag": "680802e3-0304-496f-927b-855e4167272b"}]} {{(pid=61308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 03:46:33 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [req-4dd87f11-a6b4-4b49-9a31-0365e5bc166e req-d36a7420-cbb9-47e6-8e7a-6c3c22c4b605 service nova] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:46:33 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [req-4dd87f11-a6b4-4b49-9a31-0365e5bc166e req-d36a7420-cbb9-47e6-8e7a-6c3c22c4b605 service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:46:33 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [req-4dd87f11-a6b4-4b49-9a31-0365e5bc166e req-d36a7420-cbb9-47e6-8e7a-6c3c22c4b605 service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:46:33 user devstack@n-api.service[61308]: INFO nova.api.openstack.compute.server_external_events [req-4dd87f11-a6b4-4b49-9a31-0365e5bc166e req-d36a7420-cbb9-47e6-8e7a-6c3c22c4b605 service nova] Creating event network-vif-plugged:680802e3-0304-496f-927b-855e4167272b for instance f279f3d3-581d-4d6f-924f-4104ec23832a on user Apr 23 03:46:33 user devstack@n-api.service[61308]: INFO nova.api.openstack.requestlog [req-4dd87f11-a6b4-4b49-9a31-0365e5bc166e req-d36a7420-cbb9-47e6-8e7a-6c3c22c4b605 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047356 Apr 23 03:46:33 user devstack@n-api.service[61308]: [pid: 61308|app: 0|req: 23/66] 10.0.0.210 () {68 vars in 1394 bytes} [Sun Apr 23 03:46:33 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 23 03:46:35 user devstack@n-api.service[61307]: DEBUG dbcounter [-] [61307] Writing DB stats nova_cell0:SELECT=8 {{(pid=61307) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:46:35 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi [req-0693fd3c-a9b8-4928-9d01-83c5e450552b req-79504c55-5796-45e9-aa98-4b04a2808776 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56d8da41-3e04-465b-a1de-73d9e994682d", "name": "network-vif-plugged", "status": "completed", "tag": "552bc11e-f01b-4ee4-94e0-64ab1e19ad9e"}, {"server_uuid": "08d906c5-1698-4c17-8430-c98f10836398", "name": "network-vif-plugged", "status": "completed", "tag": "71dae390-2e66-4961-8ce7-1b8fff845732"}, {"server_uuid": "08d906c5-1698-4c17-8430-c98f10836398", "name": "network-vif-plugged", "status": "completed", "tag": "71dae390-2e66-4961-8ce7-1b8fff845732"}]} {{(pid=61307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 03:46:35 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [req-0693fd3c-a9b8-4928-9d01-83c5e450552b req-79504c55-5796-45e9-aa98-4b04a2808776 service nova] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:46:35 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [req-0693fd3c-a9b8-4928-9d01-83c5e450552b req-79504c55-5796-45e9-aa98-4b04a2808776 service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:46:35 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [req-0693fd3c-a9b8-4928-9d01-83c5e450552b req-79504c55-5796-45e9-aa98-4b04a2808776 service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:46:35 user devstack@n-api.service[61307]: INFO nova.api.openstack.compute.server_external_events [req-0693fd3c-a9b8-4928-9d01-83c5e450552b req-79504c55-5796-45e9-aa98-4b04a2808776 service nova] Creating event network-vif-plugged:552bc11e-f01b-4ee4-94e0-64ab1e19ad9e for instance 56d8da41-3e04-465b-a1de-73d9e994682d on user Apr 23 03:46:35 user devstack@n-api.service[61307]: INFO nova.api.openstack.compute.server_external_events [req-0693fd3c-a9b8-4928-9d01-83c5e450552b req-79504c55-5796-45e9-aa98-4b04a2808776 service nova] Creating event network-vif-plugged:71dae390-2e66-4961-8ce7-1b8fff845732 for instance 08d906c5-1698-4c17-8430-c98f10836398 on user Apr 23 03:46:35 user devstack@n-api.service[61307]: INFO nova.api.openstack.compute.server_external_events [req-0693fd3c-a9b8-4928-9d01-83c5e450552b req-79504c55-5796-45e9-aa98-4b04a2808776 service nova] Creating event network-vif-plugged:71dae390-2e66-4961-8ce7-1b8fff845732 for instance 08d906c5-1698-4c17-8430-c98f10836398 on user Apr 23 03:46:35 user devstack@n-api.service[61307]: INFO nova.api.openstack.requestlog [req-0693fd3c-a9b8-4928-9d01-83c5e450552b req-79504c55-5796-45e9-aa98-4b04a2808776 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.079328 Apr 23 03:46:35 user devstack@n-api.service[61307]: [pid: 61307|app: 0|req: 23/67] 10.0.0.210 () {68 vars in 1394 bytes} [Sun Apr 23 03:46:35 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 23 03:46:35 user devstack@n-api.service[61306]: DEBUG dbcounter [-] [61306] Writing DB stats nova_cell0:SELECT=2 {{(pid=61306) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:46:35 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi [req-bf8cc144-36c3-434f-a176-28e53f1b535a req-001dbe34-43d9-459b-96d8-7978ea499f63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f279f3d3-581d-4d6f-924f-4104ec23832a", "name": "network-vif-plugged", "status": "completed", "tag": "680802e3-0304-496f-927b-855e4167272b"}]} {{(pid=61306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 03:46:35 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [req-bf8cc144-36c3-434f-a176-28e53f1b535a req-001dbe34-43d9-459b-96d8-7978ea499f63 service nova] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:46:35 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [req-bf8cc144-36c3-434f-a176-28e53f1b535a req-001dbe34-43d9-459b-96d8-7978ea499f63 service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:46:35 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [req-bf8cc144-36c3-434f-a176-28e53f1b535a req-001dbe34-43d9-459b-96d8-7978ea499f63 service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:46:35 user devstack@n-api.service[61306]: INFO nova.api.openstack.compute.server_external_events [req-bf8cc144-36c3-434f-a176-28e53f1b535a req-001dbe34-43d9-459b-96d8-7978ea499f63 service nova] Creating event network-vif-plugged:680802e3-0304-496f-927b-855e4167272b for instance f279f3d3-581d-4d6f-924f-4104ec23832a on user Apr 23 03:46:35 user devstack@n-api.service[61306]: INFO nova.api.openstack.requestlog [req-bf8cc144-36c3-434f-a176-28e53f1b535a req-001dbe34-43d9-459b-96d8-7978ea499f63 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056423 Apr 23 03:46:35 user devstack@n-api.service[61306]: [pid: 61306|app: 0|req: 22/68] 10.0.0.210 () {68 vars in 1394 bytes} [Sun Apr 23 03:46:35 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 23 03:46:45 user devstack@n-api.service[61308]: DEBUG dbcounter [-] [61308] Writing DB stats nova_cell0:SELECT=4 {{(pid=61308) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:46:45 user devstack@n-api.service[61308]: DEBUG dbcounter [-] [61308] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=5 {{(pid=61308) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:46:45 user devstack@n-api.service[61308]: DEBUG dbcounter [-] [61308] Writing DB stats nova_cell1:SELECT=8 {{(pid=61308) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:46:45 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi [None req-f9f3aa6a-68b0-4ffd-846f-81a316676c2d tempest-AttachSCSIVolumeTestJSON-1319344340 tempest-AttachSCSIVolumeTestJSON-1319344340-project-member] Action: 'create', calling method: .version_select at 0x7f21e1d272e0>, body: {"keypair": {"name": "tempest-keypair-282378258", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGNSlNQDdoc5OwX5MqEuWXOwleRbjHOg+KZZGXRrtYPfsqJpkBX2tsZzDLx+qRW0+E03swcsJdX8Ei+ZrkxMI0G08tG/YU2etmuLBhObrxLGe/QP38Mzd/FO6rnQsefmhQ=="}} {{(pid=61308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 03:46:45 user devstack@n-api.service[61308]: DEBUG nova.quota [None req-f9f3aa6a-68b0-4ffd-846f-81a316676c2d tempest-AttachSCSIVolumeTestJSON-1319344340 tempest-AttachSCSIVolumeTestJSON-1319344340-project-member] Getting quotas for project 0f253a2e878a45d99dd3cbda86c0c6ff. Resources: {'key_pairs'} {{(pid=61308) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 23 03:46:45 user devstack@n-api.service[61308]: DEBUG nova.quota [None req-f9f3aa6a-68b0-4ffd-846f-81a316676c2d tempest-AttachSCSIVolumeTestJSON-1319344340 tempest-AttachSCSIVolumeTestJSON-1319344340-project-member] Getting quotas for user fc51570d0e7c4617ac6b8fa428b9660f and project 0f253a2e878a45d99dd3cbda86c0c6ff. Resources: {'key_pairs'} {{(pid=61308) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 23 03:46:45 user devstack@n-api.service[61308]: INFO nova.api.openstack.requestlog [None req-f9f3aa6a-68b0-4ffd-846f-81a316676c2d tempest-AttachSCSIVolumeTestJSON-1319344340 tempest-AttachSCSIVolumeTestJSON-1319344340-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.266460 Apr 23 03:46:45 user devstack@n-api.service[61308]: [pid: 61308|app: 0|req: 24/69] 10.0.0.210 () {64 vars in 1236 bytes} [Sun Apr 23 03:46:45 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 23 03:46:49 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi [None req-6f61caac-a599-4d6f-8541-77801b995dda tempest-AttachSCSIVolumeTestJSON-1319344340 tempest-AttachSCSIVolumeTestJSON-1319344340-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-1223917650", "imageRef": "5cb75aca-167f-494a-9dae-c96fc146c1ab", "flavorRef": "42", "config_drive": true, "networks": [{"uuid": "3986d1d8-252f-42bf-99c9-3d8b53a4b69d"}], "security_groups": [{"name": "tempest-securitygroup--2105214962"}], "key_name": "tempest-keypair-282378258", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 03:46:49 user devstack@n-api.service[61307]: DEBUG dbcounter [-] [61307] Writing DB stats nova_cell0:SELECT=2 {{(pid=61307) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:46:49 user devstack@n-api.service[61307]: DEBUG dbcounter [-] [61307] Writing DB stats nova_api:SELECT=23,nova_api:INSERT=3 {{(pid=61307) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:46:49 user devstack@n-api.service[61307]: DEBUG dbcounter [-] [61307] Writing DB stats nova_cell1:SELECT=6 {{(pid=61307) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:46:49 user devstack@n-api.service[61307]: DEBUG nova.network.neutron [None req-6f61caac-a599-4d6f-8541-77801b995dda tempest-AttachSCSIVolumeTestJSON-1319344340 tempest-AttachSCSIVolumeTestJSON-1319344340-project-member] validate_networks() for [('3986d1d8-252f-42bf-99c9-3d8b53a4b69d', None, None, None, None, None)] {{(pid=61307) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 23 03:46:50 user devstack@n-api.service[61307]: DEBUG nova.virt.hardware [None req-6f61caac-a599-4d6f-8541-77801b995dda tempest-AttachSCSIVolumeTestJSON-1319344340 tempest-AttachSCSIVolumeTestJSON-1319344340-project-member] Flavor limits 0:0:0 {{(pid=61307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 23 03:46:50 user devstack@n-api.service[61307]: DEBUG nova.virt.hardware [None req-6f61caac-a599-4d6f-8541-77801b995dda tempest-AttachSCSIVolumeTestJSON-1319344340 tempest-AttachSCSIVolumeTestJSON-1319344340-project-member] Image limits 0:0:0 {{(pid=61307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 23 03:46:50 user devstack@n-api.service[61307]: DEBUG nova.virt.hardware [None req-6f61caac-a599-4d6f-8541-77801b995dda tempest-AttachSCSIVolumeTestJSON-1319344340 tempest-AttachSCSIVolumeTestJSON-1319344340-project-member] Flavor pref 0:0:0 {{(pid=61307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 23 03:46:50 user devstack@n-api.service[61307]: DEBUG nova.virt.hardware [None req-6f61caac-a599-4d6f-8541-77801b995dda tempest-AttachSCSIVolumeTestJSON-1319344340 tempest-AttachSCSIVolumeTestJSON-1319344340-project-member] Image pref 0:0:0 {{(pid=61307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 23 03:46:50 user devstack@n-api.service[61307]: DEBUG nova.virt.hardware [None req-6f61caac-a599-4d6f-8541-77801b995dda tempest-AttachSCSIVolumeTestJSON-1319344340 tempest-AttachSCSIVolumeTestJSON-1319344340-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 23 03:46:50 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-6f61caac-a599-4d6f-8541-77801b995dda tempest-AttachSCSIVolumeTestJSON-1319344340 tempest-AttachSCSIVolumeTestJSON-1319344340-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:46:50 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-6f61caac-a599-4d6f-8541-77801b995dda tempest-AttachSCSIVolumeTestJSON-1319344340 tempest-AttachSCSIVolumeTestJSON-1319344340-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:46:50 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-6f61caac-a599-4d6f-8541-77801b995dda tempest-AttachSCSIVolumeTestJSON-1319344340 tempest-AttachSCSIVolumeTestJSON-1319344340-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:46:50 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-6f61caac-a599-4d6f-8541-77801b995dda tempest-AttachSCSIVolumeTestJSON-1319344340 tempest-AttachSCSIVolumeTestJSON-1319344340-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:46:50 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-6f61caac-a599-4d6f-8541-77801b995dda tempest-AttachSCSIVolumeTestJSON-1319344340 tempest-AttachSCSIVolumeTestJSON-1319344340-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:46:50 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-6f61caac-a599-4d6f-8541-77801b995dda tempest-AttachSCSIVolumeTestJSON-1319344340 tempest-AttachSCSIVolumeTestJSON-1319344340-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:46:50 user devstack@n-api.service[61307]: DEBUG nova.quota [None req-6f61caac-a599-4d6f-8541-77801b995dda tempest-AttachSCSIVolumeTestJSON-1319344340 tempest-AttachSCSIVolumeTestJSON-1319344340-project-member] Getting quotas for project 0f253a2e878a45d99dd3cbda86c0c6ff. Resources: {'ram', 'instances', 'cores'} {{(pid=61307) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 23 03:46:50 user devstack@n-api.service[61307]: DEBUG nova.quota [None req-6f61caac-a599-4d6f-8541-77801b995dda tempest-AttachSCSIVolumeTestJSON-1319344340 tempest-AttachSCSIVolumeTestJSON-1319344340-project-member] Getting quotas for user fc51570d0e7c4617ac6b8fa428b9660f and project 0f253a2e878a45d99dd3cbda86c0c6ff. Resources: {'ram', 'instances', 'cores'} {{(pid=61307) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 23 03:46:50 user devstack@n-api.service[61307]: DEBUG nova.compute.api [None req-6f61caac-a599-4d6f-8541-77801b995dda tempest-AttachSCSIVolumeTestJSON-1319344340 tempest-AttachSCSIVolumeTestJSON-1319344340-project-member] Going to run 1 instances... {{(pid=61307) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 23 03:46:50 user devstack@n-api.service[61307]: DEBUG nova.compute.api [None req-6f61caac-a599-4d6f-8541-77801b995dda tempest-AttachSCSIVolumeTestJSON-1319344340 tempest-AttachSCSIVolumeTestJSON-1319344340-project-member] [instance: ba71c9bf-4d96-4fdc-8a55-cbdc75c29e72] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5cb75aca-167f-494a-9dae-c96fc146c1ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61307) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 23 03:46:50 user devstack@n-api.service[61307]: INFO nova.api.openstack.requestlog [None req-6f61caac-a599-4d6f-8541-77801b995dda tempest-AttachSCSIVolumeTestJSON-1319344340 tempest-AttachSCSIVolumeTestJSON-1319344340-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.221220 Apr 23 03:46:50 user devstack@n-api.service[61307]: [pid: 61307|app: 0|req: 24/70] 10.0.0.210 () {64 vars in 1224 bytes} [Sun Apr 23 03:46:49 2023] POST /compute/v2.1/servers => generated 404 bytes in 1224 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 23 03:46:50 user devstack@n-api.service[61306]: DEBUG dbcounter [-] [61306] Writing DB stats nova_api:SELECT=6 {{(pid=61306) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:46:50 user devstack@n-api.service[61306]: DEBUG dbcounter [-] [61306] Writing DB stats nova_cell1:SELECT=8 {{(pid=61306) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:46:50 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi [None req-2189371f-1a11-45b4-8615-bc9246200953 tempest-AttachSCSIVolumeTestJSON-1319344340 tempest-AttachSCSIVolumeTestJSON-1319344340-project-member] Calling method '>' {{(pid=61306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 03:46:50 user devstack@n-api.service[61306]: DEBUG nova.compute.api [None req-2189371f-1a11-45b4-8615-bc9246200953 tempest-AttachSCSIVolumeTestJSON-1319344340 tempest-AttachSCSIVolumeTestJSON-1319344340-project-member] [instance: ba71c9bf-4d96-4fdc-8a55-cbdc75c29e72] Fetching instance by UUID {{(pid=61306) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 23 03:46:50 user devstack@n-api.service[61306]: DEBUG nova.policy [None req-2189371f-1a11-45b4-8615-bc9246200953 tempest-AttachSCSIVolumeTestJSON-1319344340 tempest-AttachSCSIVolumeTestJSON-1319344340-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc51570d0e7c4617ac6b8fa428b9660f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f253a2e878a45d99dd3cbda86c0c6ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61306) authorize /opt/stack/nova/nova/policy.py:203}} Apr 23 03:46:50 user devstack@n-api.service[61306]: INFO nova.api.openstack.requestlog [None req-2189371f-1a11-45b4-8615-bc9246200953 tempest-AttachSCSIVolumeTestJSON-1319344340 tempest-AttachSCSIVolumeTestJSON-1319344340-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ba71c9bf-4d96-4fdc-8a55-cbdc75c29e72" status: 200 len: 1239 microversion: 2.1 time: 0.110955 Apr 23 03:46:50 user devstack@n-api.service[61306]: [pid: 61306|app: 0|req: 23/71] 10.0.0.210 () {62 vars in 1313 bytes} [Sun Apr 23 03:46:50 2023] GET /compute/v2.1/servers/ba71c9bf-4d96-4fdc-8a55-cbdc75c29e72 => generated 1239 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 23 03:46:57 user devstack@n-api.service[61308]: DEBUG dbcounter [-] [61308] Writing DB stats nova_cell0:SELECT=4 {{(pid=61308) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:46:57 user devstack@n-api.service[61308]: DEBUG dbcounter [-] [61308] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=61308) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:46:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi [req-777b5ae5-a4d2-4063-8a0b-270d009b815b req-20e01e54-c6b7-42f4-bff3-7bb1c99cd868 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba71c9bf-4d96-4fdc-8a55-cbdc75c29e72", "tag": "3ba908e8-68cc-4bf7-be30-d5f6bbd0ff1a"}]} {{(pid=61308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 03:46:58 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [req-777b5ae5-a4d2-4063-8a0b-270d009b815b req-20e01e54-c6b7-42f4-bff3-7bb1c99cd868 service nova] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:46:58 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [req-777b5ae5-a4d2-4063-8a0b-270d009b815b req-20e01e54-c6b7-42f4-bff3-7bb1c99cd868 service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:46:58 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [req-777b5ae5-a4d2-4063-8a0b-270d009b815b req-20e01e54-c6b7-42f4-bff3-7bb1c99cd868 service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:46:58 user devstack@n-api.service[61308]: INFO nova.api.openstack.compute.server_external_events [req-777b5ae5-a4d2-4063-8a0b-270d009b815b req-20e01e54-c6b7-42f4-bff3-7bb1c99cd868 service nova] Creating event network-changed:3ba908e8-68cc-4bf7-be30-d5f6bbd0ff1a for instance ba71c9bf-4d96-4fdc-8a55-cbdc75c29e72 on user Apr 23 03:46:58 user devstack@n-api.service[61308]: INFO nova.api.openstack.requestlog [req-777b5ae5-a4d2-4063-8a0b-270d009b815b req-20e01e54-c6b7-42f4-bff3-7bb1c99cd868 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.129545 Apr 23 03:46:58 user devstack@n-api.service[61308]: [pid: 61308|app: 0|req: 25/72] 10.0.0.210 () {68 vars in 1394 bytes} [Sun Apr 23 03:46:57 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 23 03:47:02 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi [req-b3633586-da16-4daf-9ec4-8837c3ce200a req-33d29f98-f691-427f-8b83-7d97c5668830 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba71c9bf-4d96-4fdc-8a55-cbdc75c29e72", "name": "network-vif-plugged", "status": "completed", "tag": "3ba908e8-68cc-4bf7-be30-d5f6bbd0ff1a"}]} {{(pid=61307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 03:47:02 user devstack@n-api.service[61307]: DEBUG dbcounter [-] [61307] Writing DB stats nova_cell0:SELECT=2 {{(pid=61307) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:47:02 user devstack@n-api.service[61307]: DEBUG dbcounter [-] [61307] Writing DB stats nova_cell1:SELECT=2 {{(pid=61307) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:47:02 user devstack@n-api.service[61307]: DEBUG dbcounter [-] [61307] Writing DB stats nova_cell0:SELECT=6 {{(pid=61307) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:47:02 user devstack@n-api.service[61307]: DEBUG dbcounter [-] [61307] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=3 {{(pid=61307) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:47:02 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [req-b3633586-da16-4daf-9ec4-8837c3ce200a req-33d29f98-f691-427f-8b83-7d97c5668830 service nova] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:47:02 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [req-b3633586-da16-4daf-9ec4-8837c3ce200a req-33d29f98-f691-427f-8b83-7d97c5668830 service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:47:02 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [req-b3633586-da16-4daf-9ec4-8837c3ce200a req-33d29f98-f691-427f-8b83-7d97c5668830 service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:47:02 user devstack@n-api.service[61307]: INFO nova.api.openstack.compute.server_external_events [req-b3633586-da16-4daf-9ec4-8837c3ce200a req-33d29f98-f691-427f-8b83-7d97c5668830 service nova] Creating event network-vif-plugged:3ba908e8-68cc-4bf7-be30-d5f6bbd0ff1a for instance ba71c9bf-4d96-4fdc-8a55-cbdc75c29e72 on user Apr 23 03:47:02 user devstack@n-api.service[61307]: INFO nova.api.openstack.requestlog [req-b3633586-da16-4daf-9ec4-8837c3ce200a req-33d29f98-f691-427f-8b83-7d97c5668830 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051477 Apr 23 03:47:02 user devstack@n-api.service[61307]: [pid: 61307|app: 0|req: 25/73] 10.0.0.210 () {68 vars in 1394 bytes} [Sun Apr 23 03:47:02 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 23 03:47:04 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi [None req-4d4fc02d-a4d4-4049-b19d-a42a8a44e275 tempest-DeleteServersTestJSON-2062396414 tempest-DeleteServersTestJSON-2062396414-project-member] Calling method '>' {{(pid=61306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 03:47:04 user devstack@n-api.service[61306]: DEBUG nova.compute.api [None req-4d4fc02d-a4d4-4049-b19d-a42a8a44e275 tempest-DeleteServersTestJSON-2062396414 tempest-DeleteServersTestJSON-2062396414-project-member] [instance: 56d8da41-3e04-465b-a1de-73d9e994682d] Fetching instance by UUID {{(pid=61306) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 23 03:47:04 user devstack@n-api.service[61306]: DEBUG dbcounter [-] [61306] Writing DB stats nova_api:SELECT=4 {{(pid=61306) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:47:04 user devstack@n-api.service[61306]: DEBUG dbcounter [-] [61306] Writing DB stats nova_cell0:SELECT=2 {{(pid=61306) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:47:04 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-4d4fc02d-a4d4-4049-b19d-a42a8a44e275 tempest-DeleteServersTestJSON-2062396414 tempest-DeleteServersTestJSON-2062396414-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:47:04 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-4d4fc02d-a4d4-4049-b19d-a42a8a44e275 tempest-DeleteServersTestJSON-2062396414 tempest-DeleteServersTestJSON-2062396414-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:47:04 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-4d4fc02d-a4d4-4049-b19d-a42a8a44e275 tempest-DeleteServersTestJSON-2062396414 tempest-DeleteServersTestJSON-2062396414-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:47:04 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-4d4fc02d-a4d4-4049-b19d-a42a8a44e275 tempest-DeleteServersTestJSON-2062396414 tempest-DeleteServersTestJSON-2062396414-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:47:04 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-4d4fc02d-a4d4-4049-b19d-a42a8a44e275 tempest-DeleteServersTestJSON-2062396414 tempest-DeleteServersTestJSON-2062396414-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:47:04 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-4d4fc02d-a4d4-4049-b19d-a42a8a44e275 tempest-DeleteServersTestJSON-2062396414 tempest-DeleteServersTestJSON-2062396414-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:47:04 user devstack@n-api.service[61306]: DEBUG nova.policy [None req-4d4fc02d-a4d4-4049-b19d-a42a8a44e275 tempest-DeleteServersTestJSON-2062396414 tempest-DeleteServersTestJSON-2062396414-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e6ddab9797c449d85bf6f3a241473e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f91ccdb4da4cb4bc4b55b7ac2189f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61306) authorize /opt/stack/nova/nova/policy.py:203}} Apr 23 03:47:04 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi [None req-4d830579-9d74-4b6e-b49b-cb796c3a8e7d tempest-ServerStableDeviceRescueTest-847110386 tempest-ServerStableDeviceRescueTest-847110386-project-member] Calling method '>' {{(pid=61308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 03:47:04 user devstack@n-api.service[61308]: DEBUG nova.compute.api [None req-4d830579-9d74-4b6e-b49b-cb796c3a8e7d tempest-ServerStableDeviceRescueTest-847110386 tempest-ServerStableDeviceRescueTest-847110386-project-member] [instance: f279f3d3-581d-4d6f-924f-4104ec23832a] Fetching instance by UUID {{(pid=61308) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 23 03:47:04 user devstack@n-api.service[61306]: INFO nova.api.openstack.requestlog [None req-4d4fc02d-a4d4-4049-b19d-a42a8a44e275 tempest-DeleteServersTestJSON-2062396414 tempest-DeleteServersTestJSON-2062396414-project-member] 10.0.0.210 "GET /compute/v2.1/servers/56d8da41-3e04-465b-a1de-73d9e994682d" status: 200 len: 1488 microversion: 2.1 time: 0.690648 Apr 23 03:47:04 user devstack@n-api.service[61306]: [pid: 61306|app: 0|req: 24/74] 10.0.0.210 () {62 vars in 1313 bytes} [Sun Apr 23 03:47:04 2023] GET /compute/v2.1/servers/56d8da41-3e04-465b-a1de-73d9e994682d => generated 1488 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 23 03:47:04 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-4d830579-9d74-4b6e-b49b-cb796c3a8e7d tempest-ServerStableDeviceRescueTest-847110386 tempest-ServerStableDeviceRescueTest-847110386-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:47:04 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-4d830579-9d74-4b6e-b49b-cb796c3a8e7d tempest-ServerStableDeviceRescueTest-847110386 tempest-ServerStableDeviceRescueTest-847110386-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:47:04 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-4d830579-9d74-4b6e-b49b-cb796c3a8e7d tempest-ServerStableDeviceRescueTest-847110386 tempest-ServerStableDeviceRescueTest-847110386-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:47:04 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-4d830579-9d74-4b6e-b49b-cb796c3a8e7d tempest-ServerStableDeviceRescueTest-847110386 tempest-ServerStableDeviceRescueTest-847110386-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:47:04 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-4d830579-9d74-4b6e-b49b-cb796c3a8e7d tempest-ServerStableDeviceRescueTest-847110386 tempest-ServerStableDeviceRescueTest-847110386-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:47:04 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-4d830579-9d74-4b6e-b49b-cb796c3a8e7d tempest-ServerStableDeviceRescueTest-847110386 tempest-ServerStableDeviceRescueTest-847110386-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:47:04 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi [req-73dd1c62-c228-4ceb-aa11-67fa4975fe4e req-21f6a07a-7bdc-4859-a112-d233be5df790 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba71c9bf-4d96-4fdc-8a55-cbdc75c29e72", "name": "network-vif-plugged", "status": "completed", "tag": "3ba908e8-68cc-4bf7-be30-d5f6bbd0ff1a"}]} {{(pid=61307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 03:47:04 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [req-73dd1c62-c228-4ceb-aa11-67fa4975fe4e req-21f6a07a-7bdc-4859-a112-d233be5df790 service nova] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:47:04 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [req-73dd1c62-c228-4ceb-aa11-67fa4975fe4e req-21f6a07a-7bdc-4859-a112-d233be5df790 service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:47:04 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [req-73dd1c62-c228-4ceb-aa11-67fa4975fe4e req-21f6a07a-7bdc-4859-a112-d233be5df790 service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:47:04 user devstack@n-api.service[61307]: INFO nova.api.openstack.compute.server_external_events [req-73dd1c62-c228-4ceb-aa11-67fa4975fe4e req-21f6a07a-7bdc-4859-a112-d233be5df790 service nova] Creating event network-vif-plugged:3ba908e8-68cc-4bf7-be30-d5f6bbd0ff1a for instance ba71c9bf-4d96-4fdc-8a55-cbdc75c29e72 on user Apr 23 03:47:04 user devstack@n-api.service[61307]: INFO nova.api.openstack.requestlog [req-73dd1c62-c228-4ceb-aa11-67fa4975fe4e req-21f6a07a-7bdc-4859-a112-d233be5df790 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036973 Apr 23 03:47:04 user devstack@n-api.service[61307]: [pid: 61307|app: 0|req: 26/75] 10.0.0.210 () {68 vars in 1394 bytes} [Sun Apr 23 03:47:04 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 23 03:47:05 user devstack@n-api.service[61308]: DEBUG nova.policy [None req-4d830579-9d74-4b6e-b49b-cb796c3a8e7d tempest-ServerStableDeviceRescueTest-847110386 tempest-ServerStableDeviceRescueTest-847110386-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3311b6ae249f41269fde041f6e441840', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5864626fffa7443c800b244471966d65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61308) authorize /opt/stack/nova/nova/policy.py:203}} Apr 23 03:47:05 user devstack@n-api.service[61308]: INFO nova.api.openstack.requestlog [None req-4d830579-9d74-4b6e-b49b-cb796c3a8e7d tempest-ServerStableDeviceRescueTest-847110386 tempest-ServerStableDeviceRescueTest-847110386-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f279f3d3-581d-4d6f-924f-4104ec23832a" status: 200 len: 1552 microversion: 2.1 time: 0.638609 Apr 23 03:47:05 user devstack@n-api.service[61308]: [pid: 61308|app: 0|req: 26/76] 10.0.0.210 () {62 vars in 1313 bytes} [Sun Apr 23 03:47:04 2023] GET /compute/v2.1/servers/f279f3d3-581d-4d6f-924f-4104ec23832a => generated 1552 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 23 03:47:10 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi [None req-92c1c3d2-c128-4998-8172-cab2a1c90fdb tempest-TestShelveInstance-2015082972 tempest-TestShelveInstance-2015082972-project-member] Action: 'create', calling method: .version_select at 0x7f21e14680d0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1911065508", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEalm57sZNhzMCGx8OimXfSAHtUeBl6e5+MxaGRBn/i7nGyWppJyqVY/yxK4OV9iA12zVA8Ibo0P3QwlLUhlYJrwXTUE9CXJaiXCg+gDeEz7t0SY66rakuMG41XImSjOdQ=="}} {{(pid=61306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 03:47:10 user devstack@n-api.service[61306]: DEBUG nova.quota [None req-92c1c3d2-c128-4998-8172-cab2a1c90fdb tempest-TestShelveInstance-2015082972 tempest-TestShelveInstance-2015082972-project-member] Getting quotas for project 990d99168e7947299d80d472d3d2c02f. Resources: {'key_pairs'} {{(pid=61306) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 23 03:47:10 user devstack@n-api.service[61306]: DEBUG nova.quota [None req-92c1c3d2-c128-4998-8172-cab2a1c90fdb tempest-TestShelveInstance-2015082972 tempest-TestShelveInstance-2015082972-project-member] Getting quotas for user 62a4471cd04f42d49e32b053cb052d51 and project 990d99168e7947299d80d472d3d2c02f. Resources: {'key_pairs'} {{(pid=61306) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 23 03:47:10 user devstack@n-api.service[61306]: INFO nova.api.openstack.requestlog [None req-92c1c3d2-c128-4998-8172-cab2a1c90fdb tempest-TestShelveInstance-2015082972 tempest-TestShelveInstance-2015082972-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.461849 Apr 23 03:47:10 user devstack@n-api.service[61306]: [pid: 61306|app: 0|req: 25/77] 10.0.0.210 () {64 vars in 1236 bytes} [Sun Apr 23 03:47:10 2023] POST /compute/v2.1/os-keypairs => generated 397 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 23 03:47:12 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi [None req-19672778-f15a-441a-8ae7-dd1420ebda36 tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] Calling method '>' {{(pid=61307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 03:47:12 user devstack@n-api.service[61307]: DEBUG nova.compute.api [None req-19672778-f15a-441a-8ae7-dd1420ebda36 tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] [instance: 08d906c5-1698-4c17-8430-c98f10836398] Fetching instance by UUID {{(pid=61307) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 23 03:47:12 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-19672778-f15a-441a-8ae7-dd1420ebda36 tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:47:12 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-19672778-f15a-441a-8ae7-dd1420ebda36 tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:47:12 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-19672778-f15a-441a-8ae7-dd1420ebda36 tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:47:12 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-19672778-f15a-441a-8ae7-dd1420ebda36 tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:47:12 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-19672778-f15a-441a-8ae7-dd1420ebda36 tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:47:12 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-19672778-f15a-441a-8ae7-dd1420ebda36 tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:47:12 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi [None req-c4416566-1a5d-43af-b7f1-bd099add7579 tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] Action: 'create', calling method: .version_select at 0x7f21e1d85cf0>, body: {"keypair": {"name": "tempest-keypair-1222563018", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIkvMNG9bJWjIet22ePA1ljN9zECExBTHpeziEsLPMaW1zdmYmHvghy1cyRU7fOajJrIJuDX5HLH+Bcl14bDAwDDg/IMdmy4fis8XPrCxEDMbEbjK+Rs+0/rwp2gYOoLwQ=="}} {{(pid=61308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 03:47:12 user devstack@n-api.service[61308]: DEBUG nova.quota [None req-c4416566-1a5d-43af-b7f1-bd099add7579 tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] Getting quotas for project 6f44fe9ba07e4e2f925d1a8952356e04. Resources: {'key_pairs'} {{(pid=61308) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 23 03:47:12 user devstack@n-api.service[61308]: DEBUG nova.quota [None req-c4416566-1a5d-43af-b7f1-bd099add7579 tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] Getting quotas for user cdc8fe94058c46c28d4b3f16dc1e77ed and project 6f44fe9ba07e4e2f925d1a8952356e04. Resources: {'key_pairs'} {{(pid=61308) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 23 03:47:12 user devstack@n-api.service[61308]: INFO nova.api.openstack.requestlog [None req-c4416566-1a5d-43af-b7f1-bd099add7579 tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.132198 Apr 23 03:47:12 user devstack@n-api.service[61308]: [pid: 61308|app: 0|req: 27/78] 10.0.0.210 () {64 vars in 1236 bytes} [Sun Apr 23 03:47:12 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 23 03:47:13 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi [None req-a1cbf3fe-e7fc-44d5-aba7-86774319cfaa tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Action: 'create', calling method: .version_select at 0x7f21e146b400>, body: {"keypair": {"name": "tempest-keypair-2054139165", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBChmwKzve84HsDc9e1enTU2dyNO3uMaTpP7qkGUnUryRoyEDEy7qYcgSp8YUuV2PVICAmznt0zJV+FBBbxWJ37uTbw3NkoqcDxcyXKpOSwoZ98BfcM/UT5YtXU1qwYpFAw=="}} {{(pid=61306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 03:47:13 user devstack@n-api.service[61306]: DEBUG nova.quota [None req-a1cbf3fe-e7fc-44d5-aba7-86774319cfaa tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Getting quotas for project 24fff486a500421397ecb935828582cd. Resources: {'key_pairs'} {{(pid=61306) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 23 03:47:13 user devstack@n-api.service[61306]: DEBUG nova.quota [None req-a1cbf3fe-e7fc-44d5-aba7-86774319cfaa tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Getting quotas for user 0a2c459cad014b07b2613e5e261d88aa and project 24fff486a500421397ecb935828582cd. Resources: {'key_pairs'} {{(pid=61306) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 23 03:47:13 user devstack@n-api.service[61306]: INFO nova.api.openstack.requestlog [None req-a1cbf3fe-e7fc-44d5-aba7-86774319cfaa tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.171592 Apr 23 03:47:13 user devstack@n-api.service[61306]: [pid: 61306|app: 0|req: 26/79] 10.0.0.210 () {64 vars in 1236 bytes} [Sun Apr 23 03:47:12 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 23 03:47:13 user devstack@n-api.service[61307]: DEBUG nova.policy [None req-19672778-f15a-441a-8ae7-dd1420ebda36 tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d689f1c160478ca83bbff3104d8ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b031ddc5c94ca98e7161de03bda4b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61307) authorize /opt/stack/nova/nova/policy.py:203}} Apr 23 03:47:13 user devstack@n-api.service[61307]: INFO nova.api.openstack.requestlog [None req-19672778-f15a-441a-8ae7-dd1420ebda36 tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] 10.0.0.210 "GET /compute/v2.1/servers/08d906c5-1698-4c17-8430-c98f10836398" status: 200 len: 1538 microversion: 2.1 time: 1.220007 Apr 23 03:47:13 user devstack@n-api.service[61307]: [pid: 61307|app: 0|req: 27/80] 10.0.0.210 () {62 vars in 1313 bytes} [Sun Apr 23 03:47:12 2023] GET /compute/v2.1/servers/08d906c5-1698-4c17-8430-c98f10836398 => generated 1538 bytes in 1222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 23 03:47:14 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi [None req-c421d738-3b88-4d05-88f0-40b1cf0dc20f tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1796045730", "imageRef": "e6127373-9931-4277-9458-eceef653ea1e", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "bc639aed-946f-458c-b08d-ce3037f5507c"}], "security_groups": [{"name": "tempest-securitygroup--2088115721"}], "key_name": "tempest-keypair-1222563018", "user_data": "}} {{(pid=61308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 03:47:15 user devstack@n-api.service[61308]: DEBUG nova.network.neutron [None req-c421d738-3b88-4d05-88f0-40b1cf0dc20f tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] validate_networks() for [('bc639aed-946f-458c-b08d-ce3037f5507c', None, None, None, None, None)] {{(pid=61308) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 23 03:47:15 user devstack@n-api.service[61306]: DEBUG dbcounter [-] [61306] Writing DB stats nova_cell1:SELECT=6 {{(pid=61306) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:47:15 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi [None req-6192a77e-b309-4de8-814d-7205918d22fa tempest-TestShelveInstance-2015082972 tempest-TestShelveInstance-2015082972-project-member] Calling method '.version_select at 0x7f21e14e57e0>' {{(pid=61306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 03:47:15 user devstack@n-api.service[61306]: INFO nova.api.openstack.requestlog [None req-6192a77e-b309-4de8-814d-7205918d22fa tempest-TestShelveInstance-2015082972 tempest-TestShelveInstance-2015082972-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1911065508" status: 202 len: 0 microversion: 2.1 time: 0.028981 Apr 23 03:47:15 user devstack@n-api.service[61306]: [pid: 61306|app: 0|req: 27/81] 10.0.0.210 () {62 vars in 1331 bytes} [Sun Apr 23 03:47:15 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1911065508 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 23 03:47:15 user devstack@n-api.service[61308]: DEBUG dbcounter [-] [61308] Writing DB stats nova_cell1:SELECT=8 {{(pid=61308) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:47:16 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi [None req-40643321-84d4-4946-a9f5-e0dfdc4ace4f tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-8654037", "imageRef": "e6127373-9931-4277-9458-eceef653ea1e", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "6adb189c-9b46-4da4-a34b-31edf8685498"}], "security_groups": [{"name": "tempest-securitygroup--444895585"}], "key_name": "tempest-keypair-2054139165", "user_data": "}} {{(pid=61307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 03:47:16 user devstack@n-api.service[61308]: DEBUG nova.virt.hardware [None req-c421d738-3b88-4d05-88f0-40b1cf0dc20f tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] Flavor limits 0:0:0 {{(pid=61308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 23 03:47:16 user devstack@n-api.service[61308]: DEBUG nova.virt.hardware [None req-c421d738-3b88-4d05-88f0-40b1cf0dc20f tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] Image limits 0:0:0 {{(pid=61308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 23 03:47:16 user devstack@n-api.service[61308]: DEBUG nova.virt.hardware [None req-c421d738-3b88-4d05-88f0-40b1cf0dc20f tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] Flavor pref 0:0:0 {{(pid=61308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 23 03:47:16 user devstack@n-api.service[61308]: DEBUG nova.virt.hardware [None req-c421d738-3b88-4d05-88f0-40b1cf0dc20f tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] Image pref 0:0:0 {{(pid=61308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 23 03:47:16 user devstack@n-api.service[61308]: DEBUG nova.virt.hardware [None req-c421d738-3b88-4d05-88f0-40b1cf0dc20f tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 23 03:47:16 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-c421d738-3b88-4d05-88f0-40b1cf0dc20f tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:47:16 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-c421d738-3b88-4d05-88f0-40b1cf0dc20f tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:47:16 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-c421d738-3b88-4d05-88f0-40b1cf0dc20f tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:47:16 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-c421d738-3b88-4d05-88f0-40b1cf0dc20f tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:47:16 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-c421d738-3b88-4d05-88f0-40b1cf0dc20f tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:47:16 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-c421d738-3b88-4d05-88f0-40b1cf0dc20f tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:47:16 user devstack@n-api.service[61308]: DEBUG nova.quota [None req-c421d738-3b88-4d05-88f0-40b1cf0dc20f tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] Getting quotas for project 6f44fe9ba07e4e2f925d1a8952356e04. Resources: {'ram', 'instances', 'cores'} {{(pid=61308) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 23 03:47:16 user devstack@n-api.service[61308]: DEBUG nova.quota [None req-c421d738-3b88-4d05-88f0-40b1cf0dc20f tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] Getting quotas for user cdc8fe94058c46c28d4b3f16dc1e77ed and project 6f44fe9ba07e4e2f925d1a8952356e04. Resources: {'ram', 'instances', 'cores'} {{(pid=61308) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 23 03:47:16 user devstack@n-api.service[61308]: DEBUG nova.compute.api [None req-c421d738-3b88-4d05-88f0-40b1cf0dc20f tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] Going to run 1 instances... {{(pid=61308) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 23 03:47:16 user devstack@n-api.service[61308]: DEBUG nova.compute.api [None req-c421d738-3b88-4d05-88f0-40b1cf0dc20f tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] [instance: 954f41b2-5c67-41a4-b38b-ebf3ad60cac7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e6127373-9931-4277-9458-eceef653ea1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61308) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 23 03:47:16 user devstack@n-api.service[61307]: DEBUG nova.network.neutron [None req-40643321-84d4-4946-a9f5-e0dfdc4ace4f tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] validate_networks() for [('6adb189c-9b46-4da4-a34b-31edf8685498', None, None, None, None, None)] {{(pid=61307) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 23 03:47:16 user devstack@n-api.service[61308]: INFO nova.api.openstack.requestlog [None req-c421d738-3b88-4d05-88f0-40b1cf0dc20f tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 1.623420 Apr 23 03:47:16 user devstack@n-api.service[61308]: [pid: 61308|app: 0|req: 28/82] 10.0.0.210 () {64 vars in 1224 bytes} [Sun Apr 23 03:47:14 2023] POST /compute/v2.1/servers => generated 407 bytes in 1625 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 23 03:47:16 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi [None req-48e7ab05-5305-4adb-8205-720908a9c363 tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] Calling method '>' {{(pid=61306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 03:47:16 user devstack@n-api.service[61306]: DEBUG nova.compute.api [None req-48e7ab05-5305-4adb-8205-720908a9c363 tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] [instance: 954f41b2-5c67-41a4-b38b-ebf3ad60cac7] Fetching instance by UUID {{(pid=61306) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 23 03:47:16 user devstack@n-api.service[61306]: DEBUG nova.policy [None req-48e7ab05-5305-4adb-8205-720908a9c363 tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdc8fe94058c46c28d4b3f16dc1e77ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f44fe9ba07e4e2f925d1a8952356e04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61306) authorize /opt/stack/nova/nova/policy.py:203}} Apr 23 03:47:16 user devstack@n-api.service[61306]: INFO nova.api.openstack.requestlog [None req-48e7ab05-5305-4adb-8205-720908a9c363 tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] 10.0.0.210 "GET /compute/v2.1/servers/954f41b2-5c67-41a4-b38b-ebf3ad60cac7" status: 200 len: 1233 microversion: 2.1 time: 0.205357 Apr 23 03:47:16 user devstack@n-api.service[61306]: [pid: 61306|app: 0|req: 28/83] 10.0.0.210 () {62 vars in 1313 bytes} [Sun Apr 23 03:47:16 2023] GET /compute/v2.1/servers/954f41b2-5c67-41a4-b38b-ebf3ad60cac7 => generated 1233 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 23 03:47:17 user devstack@n-api.service[61307]: DEBUG nova.virt.hardware [None req-40643321-84d4-4946-a9f5-e0dfdc4ace4f tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Flavor limits 0:0:0 {{(pid=61307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 23 03:47:17 user devstack@n-api.service[61307]: DEBUG nova.virt.hardware [None req-40643321-84d4-4946-a9f5-e0dfdc4ace4f tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Image limits 0:0:0 {{(pid=61307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 23 03:47:17 user devstack@n-api.service[61307]: DEBUG nova.virt.hardware [None req-40643321-84d4-4946-a9f5-e0dfdc4ace4f tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Flavor pref 0:0:0 {{(pid=61307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 23 03:47:17 user devstack@n-api.service[61307]: DEBUG nova.virt.hardware [None req-40643321-84d4-4946-a9f5-e0dfdc4ace4f tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Image pref 0:0:0 {{(pid=61307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 23 03:47:17 user devstack@n-api.service[61307]: DEBUG nova.virt.hardware [None req-40643321-84d4-4946-a9f5-e0dfdc4ace4f tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 23 03:47:17 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-40643321-84d4-4946-a9f5-e0dfdc4ace4f tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:47:17 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-40643321-84d4-4946-a9f5-e0dfdc4ace4f tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:47:17 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-40643321-84d4-4946-a9f5-e0dfdc4ace4f tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:47:17 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-40643321-84d4-4946-a9f5-e0dfdc4ace4f tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:47:17 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-40643321-84d4-4946-a9f5-e0dfdc4ace4f tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:47:17 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-40643321-84d4-4946-a9f5-e0dfdc4ace4f tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:47:17 user devstack@n-api.service[61307]: DEBUG nova.quota [None req-40643321-84d4-4946-a9f5-e0dfdc4ace4f tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Getting quotas for project 24fff486a500421397ecb935828582cd. Resources: {'ram', 'instances', 'cores'} {{(pid=61307) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 23 03:47:17 user devstack@n-api.service[61307]: DEBUG nova.quota [None req-40643321-84d4-4946-a9f5-e0dfdc4ace4f tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Getting quotas for user 0a2c459cad014b07b2613e5e261d88aa and project 24fff486a500421397ecb935828582cd. Resources: {'ram', 'instances', 'cores'} {{(pid=61307) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 23 03:47:17 user devstack@n-api.service[61307]: DEBUG nova.compute.api [None req-40643321-84d4-4946-a9f5-e0dfdc4ace4f tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Going to run 1 instances... {{(pid=61307) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 23 03:47:17 user devstack@n-api.service[61307]: DEBUG nova.compute.api [None req-40643321-84d4-4946-a9f5-e0dfdc4ace4f tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] [instance: 3ec36a95-88ce-4ed1-9726-7e6d98674dec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e6127373-9931-4277-9458-eceef653ea1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61307) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 23 03:47:17 user devstack@n-api.service[61307]: INFO nova.api.openstack.requestlog [None req-40643321-84d4-4946-a9f5-e0dfdc4ace4f tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 0.996933 Apr 23 03:47:17 user devstack@n-api.service[61307]: [pid: 61307|app: 0|req: 28/84] 10.0.0.210 () {64 vars in 1224 bytes} [Sun Apr 23 03:47:16 2023] POST /compute/v2.1/servers => generated 399 bytes in 999 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 23 03:47:17 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi [None req-832b9ecd-d838-4dc8-8ca2-867101d1857f tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Calling method '>' {{(pid=61308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 03:47:17 user devstack@n-api.service[61308]: DEBUG nova.compute.api [None req-832b9ecd-d838-4dc8-8ca2-867101d1857f tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] [instance: 3ec36a95-88ce-4ed1-9726-7e6d98674dec] Fetching instance by UUID {{(pid=61308) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 23 03:47:17 user devstack@n-api.service[61308]: DEBUG nova.policy [None req-832b9ecd-d838-4dc8-8ca2-867101d1857f tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2c459cad014b07b2613e5e261d88aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24fff486a500421397ecb935828582cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61308) authorize /opt/stack/nova/nova/policy.py:203}} Apr 23 03:47:17 user devstack@n-api.service[61308]: INFO nova.api.openstack.requestlog [None req-832b9ecd-d838-4dc8-8ca2-867101d1857f tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3ec36a95-88ce-4ed1-9726-7e6d98674dec" status: 200 len: 1233 microversion: 2.1 time: 0.087629 Apr 23 03:47:17 user devstack@n-api.service[61308]: [pid: 61308|app: 0|req: 29/85] 10.0.0.210 () {62 vars in 1313 bytes} [Sun Apr 23 03:47:17 2023] GET /compute/v2.1/servers/3ec36a95-88ce-4ed1-9726-7e6d98674dec => generated 1233 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 23 03:47:20 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi [req-d1a29d9d-2491-461f-911a-3dbf1de6fa09 req-9707e6c7-c385-41c6-8093-fa4d893a3a76 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "954f41b2-5c67-41a4-b38b-ebf3ad60cac7", "tag": "97d945a1-b86e-4a6d-af52-23084b8eb175"}]} {{(pid=61307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 03:47:20 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi [None req-99e2be2e-2458-4845-bce8-74df6f2d6929 tempest-VolumesAdminNegativeTest-594073230 tempest-VolumesAdminNegativeTest-594073230-project-member] Action: 'create', calling method: .version_select at 0x7f21e14e6680>, body: {"keypair": {"name": "tempest-keypair-780145109", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAkS25YZ2FFDYFsUr7jiuPczrSOLIzJlU2a693RRWPK2F4nPp0/U+VjXRqgfa72DvpZuiWhq7U6qcmOGOvf1l/Ty3NboreHITR0GpknbVZF5naj3IXms4m51pMYQyScIuQ=="}} {{(pid=61306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 03:47:20 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [req-d1a29d9d-2491-461f-911a-3dbf1de6fa09 req-9707e6c7-c385-41c6-8093-fa4d893a3a76 service nova] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:47:20 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [req-d1a29d9d-2491-461f-911a-3dbf1de6fa09 req-9707e6c7-c385-41c6-8093-fa4d893a3a76 service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:47:20 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [req-d1a29d9d-2491-461f-911a-3dbf1de6fa09 req-9707e6c7-c385-41c6-8093-fa4d893a3a76 service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:47:20 user devstack@n-api.service[61306]: DEBUG nova.quota [None req-99e2be2e-2458-4845-bce8-74df6f2d6929 tempest-VolumesAdminNegativeTest-594073230 tempest-VolumesAdminNegativeTest-594073230-project-member] Getting quotas for project 5eb0a03655cf4aa78e27c81ea4e1c424. Resources: {'key_pairs'} {{(pid=61306) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 23 03:47:20 user devstack@n-api.service[61307]: INFO nova.api.openstack.compute.server_external_events [req-d1a29d9d-2491-461f-911a-3dbf1de6fa09 req-9707e6c7-c385-41c6-8093-fa4d893a3a76 service nova] Creating event network-changed:97d945a1-b86e-4a6d-af52-23084b8eb175 for instance 954f41b2-5c67-41a4-b38b-ebf3ad60cac7 on user Apr 23 03:47:20 user devstack@n-api.service[61307]: INFO nova.api.openstack.requestlog [req-d1a29d9d-2491-461f-911a-3dbf1de6fa09 req-9707e6c7-c385-41c6-8093-fa4d893a3a76 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037013 Apr 23 03:47:20 user devstack@n-api.service[61307]: [pid: 61307|app: 0|req: 29/86] 10.0.0.210 () {68 vars in 1394 bytes} [Sun Apr 23 03:47:20 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 23 03:47:20 user devstack@n-api.service[61306]: DEBUG nova.quota [None req-99e2be2e-2458-4845-bce8-74df6f2d6929 tempest-VolumesAdminNegativeTest-594073230 tempest-VolumesAdminNegativeTest-594073230-project-member] Getting quotas for user 3e80c354abd34bd3a28ddaeec9535af2 and project 5eb0a03655cf4aa78e27c81ea4e1c424. Resources: {'key_pairs'} {{(pid=61306) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 23 03:47:20 user devstack@n-api.service[61306]: INFO nova.api.openstack.requestlog [None req-99e2be2e-2458-4845-bce8-74df6f2d6929 tempest-VolumesAdminNegativeTest-594073230 tempest-VolumesAdminNegativeTest-594073230-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.280657 Apr 23 03:47:20 user devstack@n-api.service[61306]: [pid: 61306|app: 0|req: 29/87] 10.0.0.210 () {64 vars in 1236 bytes} [Sun Apr 23 03:47:20 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 23 03:47:21 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi [req-2ca62dcb-11d8-4b93-bd74-0199d5d6812c req-23a7dd54-cf74-4a66-967d-5f7b206078fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ec36a95-88ce-4ed1-9726-7e6d98674dec", "tag": "af57258e-69b3-405b-a9f6-8d54c1810960"}]} {{(pid=61308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 03:47:21 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [req-2ca62dcb-11d8-4b93-bd74-0199d5d6812c req-23a7dd54-cf74-4a66-967d-5f7b206078fb service nova] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:47:21 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [req-2ca62dcb-11d8-4b93-bd74-0199d5d6812c req-23a7dd54-cf74-4a66-967d-5f7b206078fb service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:47:21 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [req-2ca62dcb-11d8-4b93-bd74-0199d5d6812c req-23a7dd54-cf74-4a66-967d-5f7b206078fb service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:47:21 user devstack@n-api.service[61308]: INFO nova.api.openstack.compute.server_external_events [req-2ca62dcb-11d8-4b93-bd74-0199d5d6812c req-23a7dd54-cf74-4a66-967d-5f7b206078fb service nova] Creating event network-changed:af57258e-69b3-405b-a9f6-8d54c1810960 for instance 3ec36a95-88ce-4ed1-9726-7e6d98674dec on user Apr 23 03:47:21 user devstack@n-api.service[61308]: INFO nova.api.openstack.requestlog [req-2ca62dcb-11d8-4b93-bd74-0199d5d6812c req-23a7dd54-cf74-4a66-967d-5f7b206078fb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067422 Apr 23 03:47:21 user devstack@n-api.service[61308]: [pid: 61308|app: 0|req: 30/88] 10.0.0.210 () {68 vars in 1394 bytes} [Sun Apr 23 03:47:21 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 23 03:47:23 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi [req-39a16bcd-5181-4215-accb-ebc29341007f req-919cddbe-ac93-4e47-a461-fb3de0e68b22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "954f41b2-5c67-41a4-b38b-ebf3ad60cac7", "name": "network-vif-plugged", "status": "completed", "tag": "97d945a1-b86e-4a6d-af52-23084b8eb175"}]} {{(pid=61307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 03:47:23 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [req-39a16bcd-5181-4215-accb-ebc29341007f req-919cddbe-ac93-4e47-a461-fb3de0e68b22 service nova] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:47:23 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [req-39a16bcd-5181-4215-accb-ebc29341007f req-919cddbe-ac93-4e47-a461-fb3de0e68b22 service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:47:23 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [req-39a16bcd-5181-4215-accb-ebc29341007f req-919cddbe-ac93-4e47-a461-fb3de0e68b22 service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:47:23 user devstack@n-api.service[61307]: INFO nova.api.openstack.compute.server_external_events [req-39a16bcd-5181-4215-accb-ebc29341007f req-919cddbe-ac93-4e47-a461-fb3de0e68b22 service nova] Creating event network-vif-plugged:97d945a1-b86e-4a6d-af52-23084b8eb175 for instance 954f41b2-5c67-41a4-b38b-ebf3ad60cac7 on user Apr 23 03:47:23 user devstack@n-api.service[61307]: INFO nova.api.openstack.requestlog [req-39a16bcd-5181-4215-accb-ebc29341007f req-919cddbe-ac93-4e47-a461-fb3de0e68b22 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028368 Apr 23 03:47:23 user devstack@n-api.service[61307]: [pid: 61307|app: 0|req: 30/89] 10.0.0.210 () {68 vars in 1394 bytes} [Sun Apr 23 03:47:23 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 23 03:47:23 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi [None req-c2eeaeb7-98dd-4844-917f-ee36a9c69673 tempest-VolumesAdminNegativeTest-594073230 tempest-VolumesAdminNegativeTest-594073230-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1191600208", "imageRef": "e6127373-9931-4277-9458-eceef653ea1e", "flavorRef": "42", "networks": [{"uuid": "dca689d5-53e5-466b-bd5c-4c29b330d27e"}], "security_groups": [{"name": "tempest-securitygroup--175440857"}], "key_name": "tempest-keypair-780145109", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 03:47:23 user devstack@n-api.service[61306]: DEBUG nova.network.neutron [None req-c2eeaeb7-98dd-4844-917f-ee36a9c69673 tempest-VolumesAdminNegativeTest-594073230 tempest-VolumesAdminNegativeTest-594073230-project-member] validate_networks() for [('dca689d5-53e5-466b-bd5c-4c29b330d27e', None, None, None, None, None)] {{(pid=61306) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 23 03:47:24 user devstack@n-api.service[61306]: DEBUG nova.virt.hardware [None req-c2eeaeb7-98dd-4844-917f-ee36a9c69673 tempest-VolumesAdminNegativeTest-594073230 tempest-VolumesAdminNegativeTest-594073230-project-member] Flavor limits 0:0:0 {{(pid=61306) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 23 03:47:24 user devstack@n-api.service[61306]: DEBUG nova.virt.hardware [None req-c2eeaeb7-98dd-4844-917f-ee36a9c69673 tempest-VolumesAdminNegativeTest-594073230 tempest-VolumesAdminNegativeTest-594073230-project-member] Image limits 0:0:0 {{(pid=61306) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 23 03:47:24 user devstack@n-api.service[61306]: DEBUG nova.virt.hardware [None req-c2eeaeb7-98dd-4844-917f-ee36a9c69673 tempest-VolumesAdminNegativeTest-594073230 tempest-VolumesAdminNegativeTest-594073230-project-member] Flavor pref 0:0:0 {{(pid=61306) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 23 03:47:24 user devstack@n-api.service[61306]: DEBUG nova.virt.hardware [None req-c2eeaeb7-98dd-4844-917f-ee36a9c69673 tempest-VolumesAdminNegativeTest-594073230 tempest-VolumesAdminNegativeTest-594073230-project-member] Image pref 0:0:0 {{(pid=61306) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 23 03:47:24 user devstack@n-api.service[61306]: DEBUG nova.virt.hardware [None req-c2eeaeb7-98dd-4844-917f-ee36a9c69673 tempest-VolumesAdminNegativeTest-594073230 tempest-VolumesAdminNegativeTest-594073230-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61306) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 23 03:47:24 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-c2eeaeb7-98dd-4844-917f-ee36a9c69673 tempest-VolumesAdminNegativeTest-594073230 tempest-VolumesAdminNegativeTest-594073230-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:47:24 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-c2eeaeb7-98dd-4844-917f-ee36a9c69673 tempest-VolumesAdminNegativeTest-594073230 tempest-VolumesAdminNegativeTest-594073230-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:47:24 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-c2eeaeb7-98dd-4844-917f-ee36a9c69673 tempest-VolumesAdminNegativeTest-594073230 tempest-VolumesAdminNegativeTest-594073230-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:47:24 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-c2eeaeb7-98dd-4844-917f-ee36a9c69673 tempest-VolumesAdminNegativeTest-594073230 tempest-VolumesAdminNegativeTest-594073230-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:47:24 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-c2eeaeb7-98dd-4844-917f-ee36a9c69673 tempest-VolumesAdminNegativeTest-594073230 tempest-VolumesAdminNegativeTest-594073230-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:47:24 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-c2eeaeb7-98dd-4844-917f-ee36a9c69673 tempest-VolumesAdminNegativeTest-594073230 tempest-VolumesAdminNegativeTest-594073230-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:47:24 user devstack@n-api.service[61306]: DEBUG nova.quota [None req-c2eeaeb7-98dd-4844-917f-ee36a9c69673 tempest-VolumesAdminNegativeTest-594073230 tempest-VolumesAdminNegativeTest-594073230-project-member] Getting quotas for project 5eb0a03655cf4aa78e27c81ea4e1c424. Resources: {'ram', 'instances', 'cores'} {{(pid=61306) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 23 03:47:24 user devstack@n-api.service[61306]: DEBUG nova.quota [None req-c2eeaeb7-98dd-4844-917f-ee36a9c69673 tempest-VolumesAdminNegativeTest-594073230 tempest-VolumesAdminNegativeTest-594073230-project-member] Getting quotas for user 3e80c354abd34bd3a28ddaeec9535af2 and project 5eb0a03655cf4aa78e27c81ea4e1c424. Resources: {'ram', 'instances', 'cores'} {{(pid=61306) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 23 03:47:24 user devstack@n-api.service[61306]: DEBUG nova.compute.api [None req-c2eeaeb7-98dd-4844-917f-ee36a9c69673 tempest-VolumesAdminNegativeTest-594073230 tempest-VolumesAdminNegativeTest-594073230-project-member] Going to run 1 instances... {{(pid=61306) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 23 03:47:24 user devstack@n-api.service[61306]: DEBUG nova.compute.api [None req-c2eeaeb7-98dd-4844-917f-ee36a9c69673 tempest-VolumesAdminNegativeTest-594073230 tempest-VolumesAdminNegativeTest-594073230-project-member] [instance: 91756f90-733e-4aa5-9108-d2d8b1d020fe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e6127373-9931-4277-9458-eceef653ea1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61306) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 23 03:47:24 user devstack@n-api.service[61306]: INFO nova.api.openstack.requestlog [None req-c2eeaeb7-98dd-4844-917f-ee36a9c69673 tempest-VolumesAdminNegativeTest-594073230 tempest-VolumesAdminNegativeTest-594073230-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.848200 Apr 23 03:47:24 user devstack@n-api.service[61306]: [pid: 61306|app: 0|req: 30/90] 10.0.0.210 () {64 vars in 1224 bytes} [Sun Apr 23 03:47:23 2023] POST /compute/v2.1/servers => generated 403 bytes in 850 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 23 03:47:24 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi [None req-13ad11d8-74c5-4827-95e8-7f861312b616 tempest-VolumesAdminNegativeTest-594073230 tempest-VolumesAdminNegativeTest-594073230-project-member] Calling method '>' {{(pid=61308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 03:47:24 user devstack@n-api.service[61308]: DEBUG nova.compute.api [None req-13ad11d8-74c5-4827-95e8-7f861312b616 tempest-VolumesAdminNegativeTest-594073230 tempest-VolumesAdminNegativeTest-594073230-project-member] [instance: 91756f90-733e-4aa5-9108-d2d8b1d020fe] Fetching instance by UUID {{(pid=61308) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 23 03:47:24 user devstack@n-api.service[61308]: DEBUG nova.policy [None req-13ad11d8-74c5-4827-95e8-7f861312b616 tempest-VolumesAdminNegativeTest-594073230 tempest-VolumesAdminNegativeTest-594073230-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e80c354abd34bd3a28ddaeec9535af2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb0a03655cf4aa78e27c81ea4e1c424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61308) authorize /opt/stack/nova/nova/policy.py:203}} Apr 23 03:47:24 user devstack@n-api.service[61308]: INFO nova.api.openstack.requestlog [None req-13ad11d8-74c5-4827-95e8-7f861312b616 tempest-VolumesAdminNegativeTest-594073230 tempest-VolumesAdminNegativeTest-594073230-project-member] 10.0.0.210 "GET /compute/v2.1/servers/91756f90-733e-4aa5-9108-d2d8b1d020fe" status: 200 len: 1235 microversion: 2.1 time: 0.206019 Apr 23 03:47:24 user devstack@n-api.service[61308]: [pid: 61308|app: 0|req: 31/91] 10.0.0.210 () {62 vars in 1313 bytes} [Sun Apr 23 03:47:24 2023] GET /compute/v2.1/servers/91756f90-733e-4aa5-9108-d2d8b1d020fe => generated 1235 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 23 03:47:25 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi [req-8f77cc54-656a-45fe-8263-10f179b8cdb6 req-703c5785-3fb1-4134-b943-942574fb18c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ec36a95-88ce-4ed1-9726-7e6d98674dec", "name": "network-vif-plugged", "status": "completed", "tag": "af57258e-69b3-405b-a9f6-8d54c1810960"}]} {{(pid=61307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 03:47:25 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [req-8f77cc54-656a-45fe-8263-10f179b8cdb6 req-703c5785-3fb1-4134-b943-942574fb18c3 service nova] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:47:25 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [req-8f77cc54-656a-45fe-8263-10f179b8cdb6 req-703c5785-3fb1-4134-b943-942574fb18c3 service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:47:25 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [req-8f77cc54-656a-45fe-8263-10f179b8cdb6 req-703c5785-3fb1-4134-b943-942574fb18c3 service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:47:25 user devstack@n-api.service[61307]: INFO nova.api.openstack.compute.server_external_events [req-8f77cc54-656a-45fe-8263-10f179b8cdb6 req-703c5785-3fb1-4134-b943-942574fb18c3 service nova] Creating event network-vif-plugged:af57258e-69b3-405b-a9f6-8d54c1810960 for instance 3ec36a95-88ce-4ed1-9726-7e6d98674dec on user Apr 23 03:47:25 user devstack@n-api.service[61307]: INFO nova.api.openstack.requestlog [req-8f77cc54-656a-45fe-8263-10f179b8cdb6 req-703c5785-3fb1-4134-b943-942574fb18c3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038146 Apr 23 03:47:25 user devstack@n-api.service[61307]: [pid: 61307|app: 0|req: 31/92] 10.0.0.210 () {68 vars in 1394 bytes} [Sun Apr 23 03:47:25 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 23 03:47:25 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi [req-95bd324c-1752-4d4b-9c9f-6c27fd732508 req-5c74d4c9-692e-418f-afd1-92b0c2d0bbb9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "954f41b2-5c67-41a4-b38b-ebf3ad60cac7", "name": "network-vif-plugged", "status": "completed", "tag": "97d945a1-b86e-4a6d-af52-23084b8eb175"}]} {{(pid=61306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 03:47:25 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [req-95bd324c-1752-4d4b-9c9f-6c27fd732508 req-5c74d4c9-692e-418f-afd1-92b0c2d0bbb9 service nova] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:47:25 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [req-95bd324c-1752-4d4b-9c9f-6c27fd732508 req-5c74d4c9-692e-418f-afd1-92b0c2d0bbb9 service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:47:25 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [req-95bd324c-1752-4d4b-9c9f-6c27fd732508 req-5c74d4c9-692e-418f-afd1-92b0c2d0bbb9 service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:47:25 user devstack@n-api.service[61306]: INFO nova.api.openstack.compute.server_external_events [req-95bd324c-1752-4d4b-9c9f-6c27fd732508 req-5c74d4c9-692e-418f-afd1-92b0c2d0bbb9 service nova] Creating event network-vif-plugged:97d945a1-b86e-4a6d-af52-23084b8eb175 for instance 954f41b2-5c67-41a4-b38b-ebf3ad60cac7 on user Apr 23 03:47:25 user devstack@n-api.service[61306]: INFO nova.api.openstack.requestlog [req-95bd324c-1752-4d4b-9c9f-6c27fd732508 req-5c74d4c9-692e-418f-afd1-92b0c2d0bbb9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065842 Apr 23 03:47:25 user devstack@n-api.service[61306]: [pid: 61306|app: 0|req: 31/93] 10.0.0.210 () {68 vars in 1394 bytes} [Sun Apr 23 03:47:25 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 23 03:47:27 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi [req-e257a1c9-e44f-4f53-bc65-4eabdd755d3e req-a299e933-1052-45b1-8e8e-e5ff3fe8d97d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ec36a95-88ce-4ed1-9726-7e6d98674dec", "name": "network-vif-plugged", "status": "completed", "tag": "af57258e-69b3-405b-a9f6-8d54c1810960"}]} {{(pid=61308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 03:47:27 user devstack@n-api.service[61308]: DEBUG dbcounter [-] [61308] Writing DB stats nova_cell0:SELECT=2 {{(pid=61308) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:47:27 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [req-e257a1c9-e44f-4f53-bc65-4eabdd755d3e req-a299e933-1052-45b1-8e8e-e5ff3fe8d97d service nova] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:47:27 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [req-e257a1c9-e44f-4f53-bc65-4eabdd755d3e req-a299e933-1052-45b1-8e8e-e5ff3fe8d97d service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:47:27 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [req-e257a1c9-e44f-4f53-bc65-4eabdd755d3e req-a299e933-1052-45b1-8e8e-e5ff3fe8d97d service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:47:27 user devstack@n-api.service[61308]: INFO nova.api.openstack.compute.server_external_events [req-e257a1c9-e44f-4f53-bc65-4eabdd755d3e req-a299e933-1052-45b1-8e8e-e5ff3fe8d97d service nova] Creating event network-vif-plugged:af57258e-69b3-405b-a9f6-8d54c1810960 for instance 3ec36a95-88ce-4ed1-9726-7e6d98674dec on user Apr 23 03:47:27 user devstack@n-api.service[61308]: INFO nova.api.openstack.requestlog [req-e257a1c9-e44f-4f53-bc65-4eabdd755d3e req-a299e933-1052-45b1-8e8e-e5ff3fe8d97d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038229 Apr 23 03:47:27 user devstack@n-api.service[61308]: [pid: 61308|app: 0|req: 32/94] 10.0.0.210 () {68 vars in 1394 bytes} [Sun Apr 23 03:47:27 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 23 03:47:30 user devstack@n-api.service[61307]: DEBUG dbcounter [-] [61307] Writing DB stats nova_cell0:SELECT=2 {{(pid=61307) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:47:30 user devstack@n-api.service[61307]: DEBUG dbcounter [-] [61307] Writing DB stats nova_cell0:SELECT=6 {{(pid=61307) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:47:30 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi [req-fe85a720-8f76-4791-bbc1-0c289275afe2 req-d3b2ae38-0dfa-4049-aee9-c28adf6e0378 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91756f90-733e-4aa5-9108-d2d8b1d020fe", "tag": "b7f45c1f-8b9b-4d06-a389-d7643565e934"}]} {{(pid=61307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 03:47:30 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [req-fe85a720-8f76-4791-bbc1-0c289275afe2 req-d3b2ae38-0dfa-4049-aee9-c28adf6e0378 service nova] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:47:30 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [req-fe85a720-8f76-4791-bbc1-0c289275afe2 req-d3b2ae38-0dfa-4049-aee9-c28adf6e0378 service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:47:30 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [req-fe85a720-8f76-4791-bbc1-0c289275afe2 req-d3b2ae38-0dfa-4049-aee9-c28adf6e0378 service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:47:30 user devstack@n-api.service[61307]: INFO nova.api.openstack.compute.server_external_events [req-fe85a720-8f76-4791-bbc1-0c289275afe2 req-d3b2ae38-0dfa-4049-aee9-c28adf6e0378 service nova] Creating event network-changed:b7f45c1f-8b9b-4d06-a389-d7643565e934 for instance 91756f90-733e-4aa5-9108-d2d8b1d020fe on user Apr 23 03:47:30 user devstack@n-api.service[61307]: INFO nova.api.openstack.requestlog [req-fe85a720-8f76-4791-bbc1-0c289275afe2 req-d3b2ae38-0dfa-4049-aee9-c28adf6e0378 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046189 Apr 23 03:47:30 user devstack@n-api.service[61307]: [pid: 61307|app: 0|req: 32/95] 10.0.0.210 () {68 vars in 1394 bytes} [Sun Apr 23 03:47:30 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 23 03:47:32 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi [req-fb76d5c1-e412-4697-b91d-de57c7ed7d44 req-094b7672-5560-4d74-9ec4-8ada70a87e0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91756f90-733e-4aa5-9108-d2d8b1d020fe", "name": "network-vif-plugged", "status": "completed", "tag": "b7f45c1f-8b9b-4d06-a389-d7643565e934"}]} {{(pid=61306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 03:47:32 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [req-fb76d5c1-e412-4697-b91d-de57c7ed7d44 req-094b7672-5560-4d74-9ec4-8ada70a87e0f service nova] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:47:32 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [req-fb76d5c1-e412-4697-b91d-de57c7ed7d44 req-094b7672-5560-4d74-9ec4-8ada70a87e0f service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:47:32 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [req-fb76d5c1-e412-4697-b91d-de57c7ed7d44 req-094b7672-5560-4d74-9ec4-8ada70a87e0f service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:47:32 user devstack@n-api.service[61306]: INFO nova.api.openstack.compute.server_external_events [req-fb76d5c1-e412-4697-b91d-de57c7ed7d44 req-094b7672-5560-4d74-9ec4-8ada70a87e0f service nova] Creating event network-vif-plugged:b7f45c1f-8b9b-4d06-a389-d7643565e934 for instance 91756f90-733e-4aa5-9108-d2d8b1d020fe on user Apr 23 03:47:32 user devstack@n-api.service[61306]: INFO nova.api.openstack.requestlog [req-fb76d5c1-e412-4697-b91d-de57c7ed7d44 req-094b7672-5560-4d74-9ec4-8ada70a87e0f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042954 Apr 23 03:47:32 user devstack@n-api.service[61306]: [pid: 61306|app: 0|req: 32/96] 10.0.0.210 () {68 vars in 1394 bytes} [Sun Apr 23 03:47:32 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 23 03:47:33 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi [None req-6514c139-51b8-4cda-bbb3-9e5e9029f5da tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] Action: 'create', calling method: .version_select at 0x7f21e1d87c70>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1120445103", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLKn6a8rESzq46bLmR05LGujkm1bgXgZ+9BeETyXSPwaGi5H5ZetPmCwt6N2oLGkFtyS9BduJD7406fOIM9/S2/jcwpt1OzWCv1MZI9XkD4sbEN2KdlWlfO9OLzEy4zxDA=="}} {{(pid=61308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 03:47:33 user devstack@n-api.service[61308]: DEBUG nova.quota [None req-6514c139-51b8-4cda-bbb3-9e5e9029f5da tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] Getting quotas for project 8ab0f01751954d04a83b360b2f839716. Resources: {'key_pairs'} {{(pid=61308) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 23 03:47:33 user devstack@n-api.service[61308]: DEBUG nova.quota [None req-6514c139-51b8-4cda-bbb3-9e5e9029f5da tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] Getting quotas for user 93a8dbfd8cef4578aff742813ffe901e and project 8ab0f01751954d04a83b360b2f839716. Resources: {'key_pairs'} {{(pid=61308) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 23 03:47:33 user devstack@n-api.service[61308]: INFO nova.api.openstack.requestlog [None req-6514c139-51b8-4cda-bbb3-9e5e9029f5da tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.072675 Apr 23 03:47:33 user devstack@n-api.service[61308]: [pid: 61308|app: 0|req: 33/97] 10.0.0.210 () {64 vars in 1236 bytes} [Sun Apr 23 03:47:33 2023] POST /compute/v2.1/os-keypairs => generated 403 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 23 03:47:33 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi [None req-ba6ac190-cce1-464b-a166-1e096f604f3b tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-262802774", "imageRef": "7c47c35a-5c7e-4aee-95e4-4a8cee90e1cd", "flavorRef": "42", "key_name": "tempest-TestMinimumBasicScenario-1120445103", "networks": [{"uuid": "a603a26f-3b06-4792-80ae-73cea9f9d53b"}]}} {{(pid=61307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 03:47:33 user devstack@n-api.service[61307]: DEBUG dbcounter [-] [61307] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=3 {{(pid=61307) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:47:33 user devstack@n-api.service[61307]: DEBUG nova.network.neutron [None req-ba6ac190-cce1-464b-a166-1e096f604f3b tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] validate_networks() for [('a603a26f-3b06-4792-80ae-73cea9f9d53b', None, None, None, None, None)] {{(pid=61307) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 23 03:47:34 user devstack@n-api.service[61307]: DEBUG nova.virt.hardware [None req-ba6ac190-cce1-464b-a166-1e096f604f3b tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] Flavor limits 0:0:0 {{(pid=61307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 23 03:47:34 user devstack@n-api.service[61307]: DEBUG nova.virt.hardware [None req-ba6ac190-cce1-464b-a166-1e096f604f3b tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] Image limits 0:0:0 {{(pid=61307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 23 03:47:34 user devstack@n-api.service[61307]: DEBUG nova.virt.hardware [None req-ba6ac190-cce1-464b-a166-1e096f604f3b tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] Flavor pref 0:0:0 {{(pid=61307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 23 03:47:34 user devstack@n-api.service[61307]: DEBUG nova.virt.hardware [None req-ba6ac190-cce1-464b-a166-1e096f604f3b tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] Image pref 0:0:0 {{(pid=61307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 23 03:47:34 user devstack@n-api.service[61307]: DEBUG nova.virt.hardware [None req-ba6ac190-cce1-464b-a166-1e096f604f3b tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 23 03:47:34 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-ba6ac190-cce1-464b-a166-1e096f604f3b tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:47:34 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-ba6ac190-cce1-464b-a166-1e096f604f3b tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:47:34 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-ba6ac190-cce1-464b-a166-1e096f604f3b tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:47:34 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-ba6ac190-cce1-464b-a166-1e096f604f3b tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:47:34 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-ba6ac190-cce1-464b-a166-1e096f604f3b tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:47:34 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-ba6ac190-cce1-464b-a166-1e096f604f3b tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:47:34 user devstack@n-api.service[61307]: DEBUG dbcounter [-] [61307] Writing DB stats nova_cell1:SELECT=21 {{(pid=61307) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:47:34 user devstack@n-api.service[61307]: DEBUG nova.quota [None req-ba6ac190-cce1-464b-a166-1e096f604f3b tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] Getting quotas for project 8ab0f01751954d04a83b360b2f839716. Resources: {'ram', 'instances', 'cores'} {{(pid=61307) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 23 03:47:34 user devstack@n-api.service[61307]: DEBUG nova.quota [None req-ba6ac190-cce1-464b-a166-1e096f604f3b tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] Getting quotas for user 93a8dbfd8cef4578aff742813ffe901e and project 8ab0f01751954d04a83b360b2f839716. Resources: {'ram', 'instances', 'cores'} {{(pid=61307) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 23 03:47:34 user devstack@n-api.service[61307]: DEBUG nova.compute.api [None req-ba6ac190-cce1-464b-a166-1e096f604f3b tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] Going to run 1 instances... {{(pid=61307) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 23 03:47:34 user devstack@n-api.service[61307]: DEBUG nova.compute.api [None req-ba6ac190-cce1-464b-a166-1e096f604f3b tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] [instance: 6f7cf091-3140-4746-bd1c-95c42ea82f6e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7c47c35a-5c7e-4aee-95e4-4a8cee90e1cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61307) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 23 03:47:34 user devstack@n-api.service[61307]: INFO nova.api.openstack.requestlog [None req-ba6ac190-cce1-464b-a166-1e096f604f3b tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.698719 Apr 23 03:47:34 user devstack@n-api.service[61307]: [pid: 61307|app: 0|req: 33/98] 10.0.0.210 () {64 vars in 1224 bytes} [Sun Apr 23 03:47:33 2023] POST /compute/v2.1/servers => generated 378 bytes in 702 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 23 03:47:34 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi [None req-b8ec9c5c-6f1e-4435-95bc-d0634b52ab11 tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] Calling method '>' {{(pid=61306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 03:47:34 user devstack@n-api.service[61306]: DEBUG nova.compute.api [None req-b8ec9c5c-6f1e-4435-95bc-d0634b52ab11 tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] [instance: 6f7cf091-3140-4746-bd1c-95c42ea82f6e] Fetching instance by UUID {{(pid=61306) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 23 03:47:34 user devstack@n-api.service[61306]: DEBUG dbcounter [-] [61306] Writing DB stats nova_cell0:SELECT=2 {{(pid=61306) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:47:34 user devstack@n-api.service[61306]: DEBUG dbcounter [-] [61306] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=61306) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:47:34 user devstack@n-api.service[61306]: DEBUG dbcounter [-] [61306] Writing DB stats nova_cell0:SELECT=20 {{(pid=61306) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:47:34 user devstack@n-api.service[61306]: DEBUG nova.policy [None req-b8ec9c5c-6f1e-4435-95bc-d0634b52ab11 tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93a8dbfd8cef4578aff742813ffe901e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab0f01751954d04a83b360b2f839716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61306) authorize /opt/stack/nova/nova/policy.py:203}} Apr 23 03:47:34 user devstack@n-api.service[61306]: INFO nova.api.openstack.requestlog [None req-b8ec9c5c-6f1e-4435-95bc-d0634b52ab11 tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6f7cf091-3140-4746-bd1c-95c42ea82f6e" status: 200 len: 1252 microversion: 2.1 time: 0.086473 Apr 23 03:47:34 user devstack@n-api.service[61306]: [pid: 61306|app: 0|req: 33/99] 10.0.0.210 () {62 vars in 1313 bytes} [Sun Apr 23 03:47:34 2023] GET /compute/v2.1/servers/6f7cf091-3140-4746-bd1c-95c42ea82f6e => generated 1252 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 23 03:47:34 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi [req-508356aa-4d25-4e85-9197-83b3fb28b1d7 req-b06be3b1-a005-473b-9268-5d5944c39872 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91756f90-733e-4aa5-9108-d2d8b1d020fe", "name": "network-vif-plugged", "status": "completed", "tag": "b7f45c1f-8b9b-4d06-a389-d7643565e934"}]} {{(pid=61308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 03:47:34 user devstack@n-api.service[61308]: DEBUG dbcounter [-] [61308] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=5 {{(pid=61308) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:47:34 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [req-508356aa-4d25-4e85-9197-83b3fb28b1d7 req-b06be3b1-a005-473b-9268-5d5944c39872 service nova] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:47:34 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [req-508356aa-4d25-4e85-9197-83b3fb28b1d7 req-b06be3b1-a005-473b-9268-5d5944c39872 service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:47:34 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [req-508356aa-4d25-4e85-9197-83b3fb28b1d7 req-b06be3b1-a005-473b-9268-5d5944c39872 service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:47:34 user devstack@n-api.service[61308]: INFO nova.api.openstack.compute.server_external_events [req-508356aa-4d25-4e85-9197-83b3fb28b1d7 req-b06be3b1-a005-473b-9268-5d5944c39872 service nova] Creating event network-vif-plugged:b7f45c1f-8b9b-4d06-a389-d7643565e934 for instance 91756f90-733e-4aa5-9108-d2d8b1d020fe on user Apr 23 03:47:34 user devstack@n-api.service[61308]: INFO nova.api.openstack.requestlog [req-508356aa-4d25-4e85-9197-83b3fb28b1d7 req-b06be3b1-a005-473b-9268-5d5944c39872 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036257 Apr 23 03:47:34 user devstack@n-api.service[61308]: [pid: 61308|app: 0|req: 34/100] 10.0.0.210 () {68 vars in 1394 bytes} [Sun Apr 23 03:47:34 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 23 03:47:37 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi [req-205899d8-e00b-4ab4-afc9-6e273003845a req-74804157-5d91-4fbd-9cd1-730df3d5e67f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f7cf091-3140-4746-bd1c-95c42ea82f6e", "tag": "fcf25b83-715e-4e6e-a7a3-d7f94072883f"}]} {{(pid=61307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 03:47:37 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [req-205899d8-e00b-4ab4-afc9-6e273003845a req-74804157-5d91-4fbd-9cd1-730df3d5e67f service nova] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:47:37 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [req-205899d8-e00b-4ab4-afc9-6e273003845a req-74804157-5d91-4fbd-9cd1-730df3d5e67f service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:47:37 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [req-205899d8-e00b-4ab4-afc9-6e273003845a req-74804157-5d91-4fbd-9cd1-730df3d5e67f service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:47:37 user devstack@n-api.service[61307]: INFO nova.api.openstack.compute.server_external_events [req-205899d8-e00b-4ab4-afc9-6e273003845a req-74804157-5d91-4fbd-9cd1-730df3d5e67f service nova] Creating event network-changed:fcf25b83-715e-4e6e-a7a3-d7f94072883f for instance 6f7cf091-3140-4746-bd1c-95c42ea82f6e on user Apr 23 03:47:37 user devstack@n-api.service[61307]: INFO nova.api.openstack.requestlog [req-205899d8-e00b-4ab4-afc9-6e273003845a req-74804157-5d91-4fbd-9cd1-730df3d5e67f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040955 Apr 23 03:47:37 user devstack@n-api.service[61307]: [pid: 61307|app: 0|req: 34/101] 10.0.0.210 () {68 vars in 1394 bytes} [Sun Apr 23 03:47:37 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 23 03:47:39 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi [req-7f614295-35c4-4685-9bf7-d4266aa6bccd req-815d1cf8-380c-4a99-a7cf-49a4b9517ae8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f7cf091-3140-4746-bd1c-95c42ea82f6e", "name": "network-vif-plugged", "status": "completed", "tag": "fcf25b83-715e-4e6e-a7a3-d7f94072883f"}]} {{(pid=61306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 03:47:39 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [req-7f614295-35c4-4685-9bf7-d4266aa6bccd req-815d1cf8-380c-4a99-a7cf-49a4b9517ae8 service nova] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:47:39 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [req-7f614295-35c4-4685-9bf7-d4266aa6bccd req-815d1cf8-380c-4a99-a7cf-49a4b9517ae8 service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:47:39 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [req-7f614295-35c4-4685-9bf7-d4266aa6bccd req-815d1cf8-380c-4a99-a7cf-49a4b9517ae8 service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:47:39 user devstack@n-api.service[61306]: INFO nova.api.openstack.compute.server_external_events [req-7f614295-35c4-4685-9bf7-d4266aa6bccd req-815d1cf8-380c-4a99-a7cf-49a4b9517ae8 service nova] Creating event network-vif-plugged:fcf25b83-715e-4e6e-a7a3-d7f94072883f for instance 6f7cf091-3140-4746-bd1c-95c42ea82f6e on user Apr 23 03:47:39 user devstack@n-api.service[61306]: INFO nova.api.openstack.requestlog [req-7f614295-35c4-4685-9bf7-d4266aa6bccd req-815d1cf8-380c-4a99-a7cf-49a4b9517ae8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052306 Apr 23 03:47:39 user devstack@n-api.service[61306]: [pid: 61306|app: 0|req: 34/102] 10.0.0.210 () {68 vars in 1394 bytes} [Sun Apr 23 03:47:39 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 23 03:47:40 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi [None req-8e5515a7-0ca2-40db-8bce-6c68261cd15b tempest-AttachSCSIVolumeTestJSON-1319344340 tempest-AttachSCSIVolumeTestJSON-1319344340-project-member] Calling method '>' {{(pid=61308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 03:47:40 user devstack@n-api.service[61308]: DEBUG nova.compute.api [None req-8e5515a7-0ca2-40db-8bce-6c68261cd15b tempest-AttachSCSIVolumeTestJSON-1319344340 tempest-AttachSCSIVolumeTestJSON-1319344340-project-member] [instance: ba71c9bf-4d96-4fdc-8a55-cbdc75c29e72] Fetching instance by UUID {{(pid=61308) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 23 03:47:40 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-8e5515a7-0ca2-40db-8bce-6c68261cd15b tempest-AttachSCSIVolumeTestJSON-1319344340 tempest-AttachSCSIVolumeTestJSON-1319344340-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:47:40 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-8e5515a7-0ca2-40db-8bce-6c68261cd15b tempest-AttachSCSIVolumeTestJSON-1319344340 tempest-AttachSCSIVolumeTestJSON-1319344340-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:47:40 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-8e5515a7-0ca2-40db-8bce-6c68261cd15b tempest-AttachSCSIVolumeTestJSON-1319344340 tempest-AttachSCSIVolumeTestJSON-1319344340-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:47:40 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-8e5515a7-0ca2-40db-8bce-6c68261cd15b tempest-AttachSCSIVolumeTestJSON-1319344340 tempest-AttachSCSIVolumeTestJSON-1319344340-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:47:40 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-8e5515a7-0ca2-40db-8bce-6c68261cd15b tempest-AttachSCSIVolumeTestJSON-1319344340 tempest-AttachSCSIVolumeTestJSON-1319344340-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:47:40 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-8e5515a7-0ca2-40db-8bce-6c68261cd15b tempest-AttachSCSIVolumeTestJSON-1319344340 tempest-AttachSCSIVolumeTestJSON-1319344340-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:47:40 user devstack@n-api.service[61308]: DEBUG nova.policy [None req-8e5515a7-0ca2-40db-8bce-6c68261cd15b tempest-AttachSCSIVolumeTestJSON-1319344340 tempest-AttachSCSIVolumeTestJSON-1319344340-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc51570d0e7c4617ac6b8fa428b9660f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f253a2e878a45d99dd3cbda86c0c6ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61308) authorize /opt/stack/nova/nova/policy.py:203}} Apr 23 03:47:40 user devstack@n-api.service[61308]: INFO nova.api.openstack.requestlog [None req-8e5515a7-0ca2-40db-8bce-6c68261cd15b tempest-AttachSCSIVolumeTestJSON-1319344340 tempest-AttachSCSIVolumeTestJSON-1319344340-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ba71c9bf-4d96-4fdc-8a55-cbdc75c29e72" status: 200 len: 1550 microversion: 2.1 time: 0.222230 Apr 23 03:47:40 user devstack@n-api.service[61308]: [pid: 61308|app: 0|req: 35/103] 10.0.0.210 () {62 vars in 1313 bytes} [Sun Apr 23 03:47:40 2023] GET /compute/v2.1/servers/ba71c9bf-4d96-4fdc-8a55-cbdc75c29e72 => generated 1550 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 23 03:47:42 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi [req-cf3d98a2-e50f-4ce6-a589-c0c40c1088f2 req-bd8ced29-d204-4b48-90a5-04dc70f428de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f7cf091-3140-4746-bd1c-95c42ea82f6e", "name": "network-vif-plugged", "status": "completed", "tag": "fcf25b83-715e-4e6e-a7a3-d7f94072883f"}]} {{(pid=61307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 03:47:42 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [req-cf3d98a2-e50f-4ce6-a589-c0c40c1088f2 req-bd8ced29-d204-4b48-90a5-04dc70f428de service nova] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:47:42 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [req-cf3d98a2-e50f-4ce6-a589-c0c40c1088f2 req-bd8ced29-d204-4b48-90a5-04dc70f428de service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:47:42 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [req-cf3d98a2-e50f-4ce6-a589-c0c40c1088f2 req-bd8ced29-d204-4b48-90a5-04dc70f428de service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:47:42 user devstack@n-api.service[61307]: INFO nova.api.openstack.compute.server_external_events [req-cf3d98a2-e50f-4ce6-a589-c0c40c1088f2 req-bd8ced29-d204-4b48-90a5-04dc70f428de service nova] Creating event network-vif-plugged:fcf25b83-715e-4e6e-a7a3-d7f94072883f for instance 6f7cf091-3140-4746-bd1c-95c42ea82f6e on user Apr 23 03:47:42 user devstack@n-api.service[61307]: INFO nova.api.openstack.requestlog [req-cf3d98a2-e50f-4ce6-a589-c0c40c1088f2 req-bd8ced29-d204-4b48-90a5-04dc70f428de service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038515 Apr 23 03:47:42 user devstack@n-api.service[61307]: [pid: 61307|app: 0|req: 35/104] 10.0.0.210 () {68 vars in 1394 bytes} [Sun Apr 23 03:47:42 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 23 03:48:05 user devstack@n-api.service[61306]: DEBUG dbcounter [-] [61306] Writing DB stats nova_cell0:SELECT=2 {{(pid=61306) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:48:05 user devstack@n-api.service[61306]: DEBUG dbcounter [-] [61306] Writing DB stats nova_cell1:SELECT=8 {{(pid=61306) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:48:05 user devstack@n-api.service[61306]: DEBUG dbcounter [-] [61306] Writing DB stats nova_api:SELECT=5 {{(pid=61306) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:48:05 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi [None req-e8d494a0-7aed-4e59-aa1a-050259a8cd60 tempest-ServerStableDeviceRescueTest-847110386 tempest-ServerStableDeviceRescueTest-847110386-project-member] Calling method '>' {{(pid=61306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 03:48:05 user devstack@n-api.service[61306]: DEBUG nova.compute.api [None req-e8d494a0-7aed-4e59-aa1a-050259a8cd60 tempest-ServerStableDeviceRescueTest-847110386 tempest-ServerStableDeviceRescueTest-847110386-project-member] [instance: f279f3d3-581d-4d6f-924f-4104ec23832a] Fetching instance by UUID {{(pid=61306) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 23 03:48:05 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-e8d494a0-7aed-4e59-aa1a-050259a8cd60 tempest-ServerStableDeviceRescueTest-847110386 tempest-ServerStableDeviceRescueTest-847110386-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:48:05 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-e8d494a0-7aed-4e59-aa1a-050259a8cd60 tempest-ServerStableDeviceRescueTest-847110386 tempest-ServerStableDeviceRescueTest-847110386-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:48:05 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-e8d494a0-7aed-4e59-aa1a-050259a8cd60 tempest-ServerStableDeviceRescueTest-847110386 tempest-ServerStableDeviceRescueTest-847110386-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:48:05 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-e8d494a0-7aed-4e59-aa1a-050259a8cd60 tempest-ServerStableDeviceRescueTest-847110386 tempest-ServerStableDeviceRescueTest-847110386-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:48:05 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-e8d494a0-7aed-4e59-aa1a-050259a8cd60 tempest-ServerStableDeviceRescueTest-847110386 tempest-ServerStableDeviceRescueTest-847110386-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:48:05 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-e8d494a0-7aed-4e59-aa1a-050259a8cd60 tempest-ServerStableDeviceRescueTest-847110386 tempest-ServerStableDeviceRescueTest-847110386-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:48:05 user devstack@n-api.service[61306]: INFO nova.api.openstack.requestlog [None req-e8d494a0-7aed-4e59-aa1a-050259a8cd60 tempest-ServerStableDeviceRescueTest-847110386 tempest-ServerStableDeviceRescueTest-847110386-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f279f3d3-581d-4d6f-924f-4104ec23832a/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.213248 Apr 23 03:48:05 user devstack@n-api.service[61306]: [pid: 61306|app: 0|req: 35/105] 10.0.0.210 () {62 vars in 1352 bytes} [Sun Apr 23 03:48:05 2023] GET /compute/v2.1/servers/f279f3d3-581d-4d6f-924f-4104ec23832a/os-interface => generated 283 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 23 03:48:06 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi [None req-5f6b52b7-298c-452e-a7f4-ae50dd891271 tempest-DeleteServersTestJSON-2062396414 tempest-DeleteServersTestJSON-2062396414-project-member] Calling method '>' {{(pid=61308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 03:48:06 user devstack@n-api.service[61308]: DEBUG nova.compute.api [None req-5f6b52b7-298c-452e-a7f4-ae50dd891271 tempest-DeleteServersTestJSON-2062396414 tempest-DeleteServersTestJSON-2062396414-project-member] [instance: 56d8da41-3e04-465b-a1de-73d9e994682d] Fetching instance by UUID {{(pid=61308) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 23 03:48:06 user devstack@n-api.service[61308]: DEBUG dbcounter [-] [61308] Writing DB stats nova_cell0:SELECT=18 {{(pid=61308) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:48:06 user devstack@n-api.service[61308]: DEBUG dbcounter [-] [61308] Writing DB stats nova_api:SELECT=3 {{(pid=61308) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:48:06 user devstack@n-api.service[61308]: DEBUG dbcounter [-] [61308] Writing DB stats nova_cell1:SELECT=14 {{(pid=61308) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:48:06 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-5f6b52b7-298c-452e-a7f4-ae50dd891271 tempest-DeleteServersTestJSON-2062396414 tempest-DeleteServersTestJSON-2062396414-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:48:06 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-5f6b52b7-298c-452e-a7f4-ae50dd891271 tempest-DeleteServersTestJSON-2062396414 tempest-DeleteServersTestJSON-2062396414-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:48:06 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-5f6b52b7-298c-452e-a7f4-ae50dd891271 tempest-DeleteServersTestJSON-2062396414 tempest-DeleteServersTestJSON-2062396414-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:48:06 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-5f6b52b7-298c-452e-a7f4-ae50dd891271 tempest-DeleteServersTestJSON-2062396414 tempest-DeleteServersTestJSON-2062396414-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:48:06 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-5f6b52b7-298c-452e-a7f4-ae50dd891271 tempest-DeleteServersTestJSON-2062396414 tempest-DeleteServersTestJSON-2062396414-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:48:06 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-5f6b52b7-298c-452e-a7f4-ae50dd891271 tempest-DeleteServersTestJSON-2062396414 tempest-DeleteServersTestJSON-2062396414-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:48:06 user devstack@n-api.service[61308]: DEBUG nova.compute.api [None req-5f6b52b7-298c-452e-a7f4-ae50dd891271 tempest-DeleteServersTestJSON-2062396414 tempest-DeleteServersTestJSON-2062396414-project-member] [instance: 56d8da41-3e04-465b-a1de-73d9e994682d] Going to try to terminate instance {{(pid=61308) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 23 03:48:06 user devstack@n-api.service[61308]: INFO nova.api.openstack.requestlog [None req-5f6b52b7-298c-452e-a7f4-ae50dd891271 tempest-DeleteServersTestJSON-2062396414 tempest-DeleteServersTestJSON-2062396414-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/56d8da41-3e04-465b-a1de-73d9e994682d" status: 204 len: 0 microversion: 2.1 time: 0.184813 Apr 23 03:48:06 user devstack@n-api.service[61308]: [pid: 61308|app: 0|req: 36/106] 10.0.0.210 () {62 vars in 1316 bytes} [Sun Apr 23 03:48:06 2023] DELETE /compute/v2.1/servers/56d8da41-3e04-465b-a1de-73d9e994682d => generated 0 bytes in 187 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 23 03:48:06 user devstack@n-api.service[61307]: DEBUG dbcounter [-] [61307] Writing DB stats nova_cell0:SELECT=2 {{(pid=61307) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:48:06 user devstack@n-api.service[61307]: DEBUG dbcounter [-] [61307] Writing DB stats nova_cell0:SELECT=6 {{(pid=61307) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:48:06 user devstack@n-api.service[61307]: DEBUG dbcounter [-] [61307] Writing DB stats nova_api:SELECT=18,nova_api:INSERT=3 {{(pid=61307) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:48:06 user devstack@n-api.service[61307]: DEBUG dbcounter [-] [61307] Writing DB stats nova_cell1:SELECT=5 {{(pid=61307) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:48:06 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi [None req-a9529b81-0841-4eee-9a11-6191501f8360 tempest-DeleteServersTestJSON-2062396414 tempest-DeleteServersTestJSON-2062396414-project-member] Calling method '>' {{(pid=61307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 03:48:06 user devstack@n-api.service[61307]: DEBUG nova.compute.api [None req-a9529b81-0841-4eee-9a11-6191501f8360 tempest-DeleteServersTestJSON-2062396414 tempest-DeleteServersTestJSON-2062396414-project-member] [instance: 56d8da41-3e04-465b-a1de-73d9e994682d] Fetching instance by UUID {{(pid=61307) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 23 03:48:06 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-a9529b81-0841-4eee-9a11-6191501f8360 tempest-DeleteServersTestJSON-2062396414 tempest-DeleteServersTestJSON-2062396414-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:48:06 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-a9529b81-0841-4eee-9a11-6191501f8360 tempest-DeleteServersTestJSON-2062396414 tempest-DeleteServersTestJSON-2062396414-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:48:06 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-a9529b81-0841-4eee-9a11-6191501f8360 tempest-DeleteServersTestJSON-2062396414 tempest-DeleteServersTestJSON-2062396414-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:48:06 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-a9529b81-0841-4eee-9a11-6191501f8360 tempest-DeleteServersTestJSON-2062396414 tempest-DeleteServersTestJSON-2062396414-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:48:06 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-a9529b81-0841-4eee-9a11-6191501f8360 tempest-DeleteServersTestJSON-2062396414 tempest-DeleteServersTestJSON-2062396414-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:48:06 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-a9529b81-0841-4eee-9a11-6191501f8360 tempest-DeleteServersTestJSON-2062396414 tempest-DeleteServersTestJSON-2062396414-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:48:06 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi [None req-c572b407-dd7a-4641-9338-04f3be63cb4a tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] Calling method '>' {{(pid=61306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 03:48:06 user devstack@n-api.service[61306]: DEBUG nova.compute.api [None req-c572b407-dd7a-4641-9338-04f3be63cb4a tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] [instance: 954f41b2-5c67-41a4-b38b-ebf3ad60cac7] Fetching instance by UUID {{(pid=61306) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 23 03:48:06 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-c572b407-dd7a-4641-9338-04f3be63cb4a tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:48:06 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-c572b407-dd7a-4641-9338-04f3be63cb4a tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:48:06 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-c572b407-dd7a-4641-9338-04f3be63cb4a tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:48:06 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-c572b407-dd7a-4641-9338-04f3be63cb4a tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:48:06 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-c572b407-dd7a-4641-9338-04f3be63cb4a tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:48:06 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-c572b407-dd7a-4641-9338-04f3be63cb4a tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:48:06 user devstack@n-api.service[61307]: DEBUG nova.policy [None req-a9529b81-0841-4eee-9a11-6191501f8360 tempest-DeleteServersTestJSON-2062396414 tempest-DeleteServersTestJSON-2062396414-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e6ddab9797c449d85bf6f3a241473e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4f91ccdb4da4cb4bc4b55b7ac2189f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61307) authorize /opt/stack/nova/nova/policy.py:203}} Apr 23 03:48:06 user devstack@n-api.service[61307]: INFO nova.api.openstack.requestlog [None req-a9529b81-0841-4eee-9a11-6191501f8360 tempest-DeleteServersTestJSON-2062396414 tempest-DeleteServersTestJSON-2062396414-project-member] 10.0.0.210 "GET /compute/v2.1/servers/56d8da41-3e04-465b-a1de-73d9e994682d" status: 200 len: 1494 microversion: 2.1 time: 0.314738 Apr 23 03:48:06 user devstack@n-api.service[61307]: [pid: 61307|app: 0|req: 36/107] 10.0.0.210 () {62 vars in 1313 bytes} [Sun Apr 23 03:48:06 2023] GET /compute/v2.1/servers/56d8da41-3e04-465b-a1de-73d9e994682d => generated 1494 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 23 03:48:07 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi [req-affcbc82-ce55-49cc-a2c2-73a8796726ba req-8d0db0d5-9859-46fe-ab2f-fdb33f1c42b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56d8da41-3e04-465b-a1de-73d9e994682d", "name": "network-vif-unplugged", "status": "completed", "tag": "552bc11e-f01b-4ee4-94e0-64ab1e19ad9e"}]} {{(pid=61308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 03:48:07 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [req-affcbc82-ce55-49cc-a2c2-73a8796726ba req-8d0db0d5-9859-46fe-ab2f-fdb33f1c42b9 service nova] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:48:07 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [req-affcbc82-ce55-49cc-a2c2-73a8796726ba req-8d0db0d5-9859-46fe-ab2f-fdb33f1c42b9 service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:48:07 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [req-affcbc82-ce55-49cc-a2c2-73a8796726ba req-8d0db0d5-9859-46fe-ab2f-fdb33f1c42b9 service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:48:07 user devstack@n-api.service[61308]: INFO nova.api.openstack.compute.server_external_events [req-affcbc82-ce55-49cc-a2c2-73a8796726ba req-8d0db0d5-9859-46fe-ab2f-fdb33f1c42b9 service nova] Creating event network-vif-unplugged:552bc11e-f01b-4ee4-94e0-64ab1e19ad9e for instance 56d8da41-3e04-465b-a1de-73d9e994682d on user Apr 23 03:48:07 user devstack@n-api.service[61308]: INFO nova.api.openstack.requestlog [req-affcbc82-ce55-49cc-a2c2-73a8796726ba req-8d0db0d5-9859-46fe-ab2f-fdb33f1c42b9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029068 Apr 23 03:48:07 user devstack@n-api.service[61308]: [pid: 61308|app: 0|req: 37/108] 10.0.0.210 () {68 vars in 1394 bytes} [Sun Apr 23 03:48:07 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 23 03:48:07 user devstack@n-api.service[61306]: DEBUG nova.policy [None req-c572b407-dd7a-4641-9338-04f3be63cb4a tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdc8fe94058c46c28d4b3f16dc1e77ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f44fe9ba07e4e2f925d1a8952356e04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61306) authorize /opt/stack/nova/nova/policy.py:203}} Apr 23 03:48:07 user devstack@n-api.service[61306]: INFO nova.api.openstack.requestlog [None req-c572b407-dd7a-4641-9338-04f3be63cb4a tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] 10.0.0.210 "GET /compute/v2.1/servers/954f41b2-5c67-41a4-b38b-ebf3ad60cac7" status: 200 len: 1539 microversion: 2.1 time: 0.390259 Apr 23 03:48:07 user devstack@n-api.service[61306]: [pid: 61306|app: 0|req: 36/109] 10.0.0.210 () {62 vars in 1313 bytes} [Sun Apr 23 03:48:06 2023] GET /compute/v2.1/servers/954f41b2-5c67-41a4-b38b-ebf3ad60cac7 => generated 1539 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 23 03:48:07 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi [None req-d5c0ab00-e3cf-4c6c-97dd-6e446669e3bc tempest-ServerStableDeviceRescueTest-847110386 tempest-ServerStableDeviceRescueTest-847110386-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerStableDeviceRescueTest-image-1616510043"}} {{(pid=61307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 03:48:07 user devstack@n-api.service[61307]: DEBUG nova.compute.api [None req-d5c0ab00-e3cf-4c6c-97dd-6e446669e3bc tempest-ServerStableDeviceRescueTest-847110386 tempest-ServerStableDeviceRescueTest-847110386-project-member] [instance: f279f3d3-581d-4d6f-924f-4104ec23832a] Fetching instance by UUID {{(pid=61307) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 23 03:48:07 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-d5c0ab00-e3cf-4c6c-97dd-6e446669e3bc tempest-ServerStableDeviceRescueTest-847110386 tempest-ServerStableDeviceRescueTest-847110386-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:48:07 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-d5c0ab00-e3cf-4c6c-97dd-6e446669e3bc tempest-ServerStableDeviceRescueTest-847110386 tempest-ServerStableDeviceRescueTest-847110386-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:48:07 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-d5c0ab00-e3cf-4c6c-97dd-6e446669e3bc tempest-ServerStableDeviceRescueTest-847110386 tempest-ServerStableDeviceRescueTest-847110386-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:48:07 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-d5c0ab00-e3cf-4c6c-97dd-6e446669e3bc tempest-ServerStableDeviceRescueTest-847110386 tempest-ServerStableDeviceRescueTest-847110386-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:48:07 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-d5c0ab00-e3cf-4c6c-97dd-6e446669e3bc tempest-ServerStableDeviceRescueTest-847110386 tempest-ServerStableDeviceRescueTest-847110386-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:48:07 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-d5c0ab00-e3cf-4c6c-97dd-6e446669e3bc tempest-ServerStableDeviceRescueTest-847110386 tempest-ServerStableDeviceRescueTest-847110386-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:48:07 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi [None req-8e1553a4-abf5-422f-9cf5-210e30d14857 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Calling method '>' {{(pid=61308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 03:48:07 user devstack@n-api.service[61308]: DEBUG nova.compute.api [None req-8e1553a4-abf5-422f-9cf5-210e30d14857 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] [instance: 3ec36a95-88ce-4ed1-9726-7e6d98674dec] Fetching instance by UUID {{(pid=61308) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 23 03:48:07 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-8e1553a4-abf5-422f-9cf5-210e30d14857 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:48:07 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-8e1553a4-abf5-422f-9cf5-210e30d14857 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:48:07 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-8e1553a4-abf5-422f-9cf5-210e30d14857 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:48:07 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-8e1553a4-abf5-422f-9cf5-210e30d14857 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:48:07 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-8e1553a4-abf5-422f-9cf5-210e30d14857 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:48:07 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-8e1553a4-abf5-422f-9cf5-210e30d14857 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:48:07 user devstack@n-api.service[61308]: DEBUG nova.policy [None req-8e1553a4-abf5-422f-9cf5-210e30d14857 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2c459cad014b07b2613e5e261d88aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24fff486a500421397ecb935828582cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61308) authorize /opt/stack/nova/nova/policy.py:203}} Apr 23 03:48:07 user devstack@n-api.service[61308]: INFO nova.api.openstack.requestlog [None req-8e1553a4-abf5-422f-9cf5-210e30d14857 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3ec36a95-88ce-4ed1-9726-7e6d98674dec" status: 200 len: 1541 microversion: 2.1 time: 0.208822 Apr 23 03:48:07 user devstack@n-api.service[61308]: [pid: 61308|app: 0|req: 38/110] 10.0.0.210 () {62 vars in 1313 bytes} [Sun Apr 23 03:48:07 2023] GET /compute/v2.1/servers/3ec36a95-88ce-4ed1-9726-7e6d98674dec => generated 1541 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 23 03:48:08 user devstack@n-api.service[61307]: INFO nova.api.openstack.requestlog [None req-d5c0ab00-e3cf-4c6c-97dd-6e446669e3bc tempest-ServerStableDeviceRescueTest-847110386 tempest-ServerStableDeviceRescueTest-847110386-project-member] 10.0.0.210 "POST /compute/v2.1/servers/f279f3d3-581d-4d6f-924f-4104ec23832a/action" status: 202 len: 0 microversion: 2.1 time: 0.832104 Apr 23 03:48:08 user devstack@n-api.service[61307]: [pid: 61307|app: 0|req: 37/111] 10.0.0.210 () {64 vars in 1355 bytes} [Sun Apr 23 03:48:07 2023] POST /compute/v2.1/servers/f279f3d3-581d-4d6f-924f-4104ec23832a/action => generated 0 bytes in 834 msecs (HTTP/1.1 202) 10 headers in 449 bytes (2 switches on core 0) Apr 23 03:48:08 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi [None req-8af3bad8-5bd0-44e9-819b-87e440144fe7 tempest-ServerStableDeviceRescueTest-847110386 tempest-ServerStableDeviceRescueTest-847110386-project-member] Calling method '.version_select at 0x7f21e14e5d80>' {{(pid=61306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 03:48:08 user devstack@n-api.service[61306]: INFO nova.api.openstack.requestlog [None req-8af3bad8-5bd0-44e9-819b-87e440144fe7 tempest-ServerStableDeviceRescueTest-847110386 tempest-ServerStableDeviceRescueTest-847110386-project-member] 10.0.0.210 "GET /compute/v2.1/images/ed2ff9e4-bed2-49af-99bb-51a7c0bfa96f" status: 200 len: 1609 microversion: 2.1 time: 0.053146 Apr 23 03:48:08 user devstack@n-api.service[61306]: [pid: 61306|app: 0|req: 37/112] 10.0.0.210 () {62 vars in 1310 bytes} [Sun Apr 23 03:48:08 2023] GET /compute/v2.1/images/ed2ff9e4-bed2-49af-99bb-51a7c0bfa96f => generated 1609 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 23 03:48:08 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi [req-1e6967a9-84b7-49ee-8e9d-858c9188c24d req-c65f068b-8d1e-4285-913b-16f4cd851c29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56d8da41-3e04-465b-a1de-73d9e994682d", "name": "network-vif-deleted", "tag": "552bc11e-f01b-4ee4-94e0-64ab1e19ad9e"}]} {{(pid=61308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 03:48:08 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [req-1e6967a9-84b7-49ee-8e9d-858c9188c24d req-c65f068b-8d1e-4285-913b-16f4cd851c29 service nova] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:48:08 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [req-1e6967a9-84b7-49ee-8e9d-858c9188c24d req-c65f068b-8d1e-4285-913b-16f4cd851c29 service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:48:08 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [req-1e6967a9-84b7-49ee-8e9d-858c9188c24d req-c65f068b-8d1e-4285-913b-16f4cd851c29 service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:48:08 user devstack@n-api.service[61308]: INFO nova.api.openstack.compute.server_external_events [req-1e6967a9-84b7-49ee-8e9d-858c9188c24d req-c65f068b-8d1e-4285-913b-16f4cd851c29 service nova] Creating event network-vif-deleted:552bc11e-f01b-4ee4-94e0-64ab1e19ad9e for instance 56d8da41-3e04-465b-a1de-73d9e994682d on user Apr 23 03:48:08 user devstack@n-api.service[61308]: INFO nova.api.openstack.requestlog [req-1e6967a9-84b7-49ee-8e9d-858c9188c24d req-c65f068b-8d1e-4285-913b-16f4cd851c29 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032620 Apr 23 03:48:08 user devstack@n-api.service[61308]: [pid: 61308|app: 0|req: 39/113] 10.0.0.210 () {68 vars in 1394 bytes} [Sun Apr 23 03:48:08 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 23 03:48:09 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi [req-a99e8c8f-c6e8-40f3-a14d-ebadae33b952 req-acb75be2-c89c-4101-8ae6-49e3ff8ced46 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f279f3d3-581d-4d6f-924f-4104ec23832a", "tag": "680802e3-0304-496f-927b-855e4167272b"}, {"server_uuid": "56d8da41-3e04-465b-a1de-73d9e994682d", "name": "network-vif-plugged", "status": "completed", "tag": "552bc11e-f01b-4ee4-94e0-64ab1e19ad9e"}]} {{(pid=61307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 03:48:09 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [req-a99e8c8f-c6e8-40f3-a14d-ebadae33b952 req-acb75be2-c89c-4101-8ae6-49e3ff8ced46 service nova] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:48:09 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [req-a99e8c8f-c6e8-40f3-a14d-ebadae33b952 req-acb75be2-c89c-4101-8ae6-49e3ff8ced46 service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:48:09 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [req-a99e8c8f-c6e8-40f3-a14d-ebadae33b952 req-acb75be2-c89c-4101-8ae6-49e3ff8ced46 service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:48:09 user devstack@n-api.service[61307]: INFO nova.api.openstack.compute.server_external_events [req-a99e8c8f-c6e8-40f3-a14d-ebadae33b952 req-acb75be2-c89c-4101-8ae6-49e3ff8ced46 service nova] Creating event network-changed:680802e3-0304-496f-927b-855e4167272b for instance f279f3d3-581d-4d6f-924f-4104ec23832a on user Apr 23 03:48:09 user devstack@n-api.service[61307]: INFO nova.api.openstack.compute.server_external_events [req-a99e8c8f-c6e8-40f3-a14d-ebadae33b952 req-acb75be2-c89c-4101-8ae6-49e3ff8ced46 service nova] Creating event network-vif-plugged:552bc11e-f01b-4ee4-94e0-64ab1e19ad9e for instance 56d8da41-3e04-465b-a1de-73d9e994682d on user Apr 23 03:48:09 user devstack@n-api.service[61307]: INFO nova.api.openstack.requestlog [req-a99e8c8f-c6e8-40f3-a14d-ebadae33b952 req-acb75be2-c89c-4101-8ae6-49e3ff8ced46 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.035448 Apr 23 03:48:09 user devstack@n-api.service[61307]: [pid: 61307|app: 0|req: 38/114] 10.0.0.210 () {68 vars in 1394 bytes} [Sun Apr 23 03:48:09 2023] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 23 03:48:13 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi [None req-2d8682bb-3e16-443e-bb76-42312f130acd tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] Calling method '>' {{(pid=61306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 03:48:13 user devstack@n-api.service[61306]: DEBUG nova.compute.api [None req-2d8682bb-3e16-443e-bb76-42312f130acd tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] [instance: 08d906c5-1698-4c17-8430-c98f10836398] Fetching instance by UUID {{(pid=61306) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 23 03:48:13 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-2d8682bb-3e16-443e-bb76-42312f130acd tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:48:13 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-2d8682bb-3e16-443e-bb76-42312f130acd tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:48:13 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-2d8682bb-3e16-443e-bb76-42312f130acd tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:48:13 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-2d8682bb-3e16-443e-bb76-42312f130acd tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:48:13 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-2d8682bb-3e16-443e-bb76-42312f130acd tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:48:13 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-2d8682bb-3e16-443e-bb76-42312f130acd tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:48:13 user devstack@n-api.service[61306]: INFO nova.api.openstack.requestlog [None req-2d8682bb-3e16-443e-bb76-42312f130acd tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] 10.0.0.210 "GET /compute/v2.1/servers/08d906c5-1698-4c17-8430-c98f10836398/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.156810 Apr 23 03:48:13 user devstack@n-api.service[61306]: [pid: 61306|app: 0|req: 38/115] 10.0.0.210 () {62 vars in 1352 bytes} [Sun Apr 23 03:48:13 2023] GET /compute/v2.1/servers/08d906c5-1698-4c17-8430-c98f10836398/os-interface => generated 283 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 23 03:48:14 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi [req-d0d9aae9-3db4-445f-9295-30dfabb7e304 req-800e7fb1-eaf6-438e-aa04-dff46bb667a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08d906c5-1698-4c17-8430-c98f10836398", "tag": "71dae390-2e66-4961-8ce7-1b8fff845732"}]} {{(pid=61308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 03:48:14 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [req-d0d9aae9-3db4-445f-9295-30dfabb7e304 req-800e7fb1-eaf6-438e-aa04-dff46bb667a9 service nova] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:48:14 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [req-d0d9aae9-3db4-445f-9295-30dfabb7e304 req-800e7fb1-eaf6-438e-aa04-dff46bb667a9 service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:48:14 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [req-d0d9aae9-3db4-445f-9295-30dfabb7e304 req-800e7fb1-eaf6-438e-aa04-dff46bb667a9 service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:48:14 user devstack@n-api.service[61308]: INFO nova.api.openstack.compute.server_external_events [req-d0d9aae9-3db4-445f-9295-30dfabb7e304 req-800e7fb1-eaf6-438e-aa04-dff46bb667a9 service nova] Creating event network-changed:71dae390-2e66-4961-8ce7-1b8fff845732 for instance 08d906c5-1698-4c17-8430-c98f10836398 on user Apr 23 03:48:14 user devstack@n-api.service[61308]: INFO nova.api.openstack.requestlog [req-d0d9aae9-3db4-445f-9295-30dfabb7e304 req-800e7fb1-eaf6-438e-aa04-dff46bb667a9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029126 Apr 23 03:48:14 user devstack@n-api.service[61308]: [pid: 61308|app: 0|req: 40/116] 10.0.0.210 () {68 vars in 1394 bytes} [Sun Apr 23 03:48:14 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 23 03:48:14 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi [None req-52589878-e103-4b4b-840f-ee87ecf14be3 tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] Calling method '>' {{(pid=61307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 03:48:14 user devstack@n-api.service[61307]: DEBUG nova.compute.api [None req-52589878-e103-4b4b-840f-ee87ecf14be3 tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] [instance: 08d906c5-1698-4c17-8430-c98f10836398] Fetching instance by UUID {{(pid=61307) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 23 03:48:14 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-52589878-e103-4b4b-840f-ee87ecf14be3 tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:48:14 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-52589878-e103-4b4b-840f-ee87ecf14be3 tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:48:14 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-52589878-e103-4b4b-840f-ee87ecf14be3 tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:48:14 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-52589878-e103-4b4b-840f-ee87ecf14be3 tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:48:14 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-52589878-e103-4b4b-840f-ee87ecf14be3 tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:48:14 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-52589878-e103-4b4b-840f-ee87ecf14be3 tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:48:14 user devstack@n-api.service[61307]: INFO nova.api.openstack.requestlog [None req-52589878-e103-4b4b-840f-ee87ecf14be3 tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] 10.0.0.210 "GET /compute/v2.1/servers/08d906c5-1698-4c17-8430-c98f10836398/ips" status: 200 len: 105 microversion: 2.1 time: 0.036961 Apr 23 03:48:14 user devstack@n-api.service[61307]: [pid: 61307|app: 0|req: 39/117] 10.0.0.210 () {62 vars in 1325 bytes} [Sun Apr 23 03:48:14 2023] GET /compute/v2.1/servers/08d906c5-1698-4c17-8430-c98f10836398/ips => generated 105 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 23 03:48:14 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi [None req-a3b4d3b0-14da-4b00-9c8d-e2e66ad4d750 tempest-VolumesAdminNegativeTest-594073230 tempest-VolumesAdminNegativeTest-594073230-project-member] Calling method '>' {{(pid=61306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 03:48:14 user devstack@n-api.service[61306]: DEBUG nova.compute.api [None req-a3b4d3b0-14da-4b00-9c8d-e2e66ad4d750 tempest-VolumesAdminNegativeTest-594073230 tempest-VolumesAdminNegativeTest-594073230-project-member] [instance: 91756f90-733e-4aa5-9108-d2d8b1d020fe] Fetching instance by UUID {{(pid=61306) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 23 03:48:15 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-a3b4d3b0-14da-4b00-9c8d-e2e66ad4d750 tempest-VolumesAdminNegativeTest-594073230 tempest-VolumesAdminNegativeTest-594073230-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:48:15 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-a3b4d3b0-14da-4b00-9c8d-e2e66ad4d750 tempest-VolumesAdminNegativeTest-594073230 tempest-VolumesAdminNegativeTest-594073230-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:48:15 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-a3b4d3b0-14da-4b00-9c8d-e2e66ad4d750 tempest-VolumesAdminNegativeTest-594073230 tempest-VolumesAdminNegativeTest-594073230-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:48:15 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-a3b4d3b0-14da-4b00-9c8d-e2e66ad4d750 tempest-VolumesAdminNegativeTest-594073230 tempest-VolumesAdminNegativeTest-594073230-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:48:15 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-a3b4d3b0-14da-4b00-9c8d-e2e66ad4d750 tempest-VolumesAdminNegativeTest-594073230 tempest-VolumesAdminNegativeTest-594073230-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:48:15 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-a3b4d3b0-14da-4b00-9c8d-e2e66ad4d750 tempest-VolumesAdminNegativeTest-594073230 tempest-VolumesAdminNegativeTest-594073230-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:48:15 user devstack@n-api.service[61306]: DEBUG nova.policy [None req-a3b4d3b0-14da-4b00-9c8d-e2e66ad4d750 tempest-VolumesAdminNegativeTest-594073230 tempest-VolumesAdminNegativeTest-594073230-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e80c354abd34bd3a28ddaeec9535af2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb0a03655cf4aa78e27c81ea4e1c424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61306) authorize /opt/stack/nova/nova/policy.py:203}} Apr 23 03:48:15 user devstack@n-api.service[61306]: INFO nova.api.openstack.requestlog [None req-a3b4d3b0-14da-4b00-9c8d-e2e66ad4d750 tempest-VolumesAdminNegativeTest-594073230 tempest-VolumesAdminNegativeTest-594073230-project-member] 10.0.0.210 "GET /compute/v2.1/servers/91756f90-733e-4aa5-9108-d2d8b1d020fe" status: 200 len: 1544 microversion: 2.1 time: 0.284627 Apr 23 03:48:15 user devstack@n-api.service[61306]: [pid: 61306|app: 0|req: 39/118] 10.0.0.210 () {62 vars in 1313 bytes} [Sun Apr 23 03:48:14 2023] GET /compute/v2.1/servers/91756f90-733e-4aa5-9108-d2d8b1d020fe => generated 1544 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 23 03:48:16 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi [None req-d8176489-0d45-4827-babd-28d7db9dc1d3 tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] Calling method '>' {{(pid=61308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 03:48:16 user devstack@n-api.service[61308]: DEBUG nova.compute.api [None req-d8176489-0d45-4827-babd-28d7db9dc1d3 tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] [instance: 08d906c5-1698-4c17-8430-c98f10836398] Fetching instance by UUID {{(pid=61308) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 23 03:48:16 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-d8176489-0d45-4827-babd-28d7db9dc1d3 tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:48:16 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-d8176489-0d45-4827-babd-28d7db9dc1d3 tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:48:16 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-d8176489-0d45-4827-babd-28d7db9dc1d3 tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:48:16 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-d8176489-0d45-4827-babd-28d7db9dc1d3 tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:48:16 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-d8176489-0d45-4827-babd-28d7db9dc1d3 tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:48:16 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-d8176489-0d45-4827-babd-28d7db9dc1d3 tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:48:16 user devstack@n-api.service[61308]: DEBUG nova.compute.api [None req-d8176489-0d45-4827-babd-28d7db9dc1d3 tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] [instance: 08d906c5-1698-4c17-8430-c98f10836398] Going to try to terminate instance {{(pid=61308) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 23 03:48:16 user devstack@n-api.service[61308]: INFO nova.api.openstack.requestlog [None req-d8176489-0d45-4827-babd-28d7db9dc1d3 tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/08d906c5-1698-4c17-8430-c98f10836398" status: 204 len: 0 microversion: 2.1 time: 0.114925 Apr 23 03:48:16 user devstack@n-api.service[61308]: [pid: 61308|app: 0|req: 41/119] 10.0.0.210 () {62 vars in 1316 bytes} [Sun Apr 23 03:48:16 2023] DELETE /compute/v2.1/servers/08d906c5-1698-4c17-8430-c98f10836398 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 23 03:48:16 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi [None req-877a4660-47c6-4c2e-936e-60af04225fd7 tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] Calling method '>' {{(pid=61307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 03:48:16 user devstack@n-api.service[61307]: DEBUG nova.compute.api [None req-877a4660-47c6-4c2e-936e-60af04225fd7 tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] [instance: 08d906c5-1698-4c17-8430-c98f10836398] Fetching instance by UUID {{(pid=61307) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 23 03:48:16 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-877a4660-47c6-4c2e-936e-60af04225fd7 tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:48:16 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-877a4660-47c6-4c2e-936e-60af04225fd7 tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:48:16 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-877a4660-47c6-4c2e-936e-60af04225fd7 tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:48:16 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-877a4660-47c6-4c2e-936e-60af04225fd7 tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:48:16 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-877a4660-47c6-4c2e-936e-60af04225fd7 tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:48:16 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-877a4660-47c6-4c2e-936e-60af04225fd7 tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:48:16 user devstack@n-api.service[61307]: DEBUG nova.policy [None req-877a4660-47c6-4c2e-936e-60af04225fd7 tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d689f1c160478ca83bbff3104d8ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b031ddc5c94ca98e7161de03bda4b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61307) authorize /opt/stack/nova/nova/policy.py:203}} Apr 23 03:48:16 user devstack@n-api.service[61307]: INFO nova.api.openstack.requestlog [None req-877a4660-47c6-4c2e-936e-60af04225fd7 tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] 10.0.0.210 "GET /compute/v2.1/servers/08d906c5-1698-4c17-8430-c98f10836398" status: 200 len: 1662 microversion: 2.1 time: 0.289201 Apr 23 03:48:16 user devstack@n-api.service[61307]: [pid: 61307|app: 0|req: 40/120] 10.0.0.210 () {62 vars in 1313 bytes} [Sun Apr 23 03:48:16 2023] GET /compute/v2.1/servers/08d906c5-1698-4c17-8430-c98f10836398 => generated 1662 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 23 03:48:16 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi [req-6011d725-b988-4944-9df9-4f954d998e8a req-a77c36db-6117-4ce5-8f68-c0397e06c491 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08d906c5-1698-4c17-8430-c98f10836398", "name": "network-vif-unplugged", "status": "completed", "tag": "71dae390-2e66-4961-8ce7-1b8fff845732"}]} {{(pid=61306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 03:48:16 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [req-6011d725-b988-4944-9df9-4f954d998e8a req-a77c36db-6117-4ce5-8f68-c0397e06c491 service nova] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:48:16 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [req-6011d725-b988-4944-9df9-4f954d998e8a req-a77c36db-6117-4ce5-8f68-c0397e06c491 service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:48:16 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [req-6011d725-b988-4944-9df9-4f954d998e8a req-a77c36db-6117-4ce5-8f68-c0397e06c491 service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:48:16 user devstack@n-api.service[61306]: INFO nova.api.openstack.compute.server_external_events [req-6011d725-b988-4944-9df9-4f954d998e8a req-a77c36db-6117-4ce5-8f68-c0397e06c491 service nova] Creating event network-vif-unplugged:71dae390-2e66-4961-8ce7-1b8fff845732 for instance 08d906c5-1698-4c17-8430-c98f10836398 on user Apr 23 03:48:16 user devstack@n-api.service[61306]: INFO nova.api.openstack.requestlog [req-6011d725-b988-4944-9df9-4f954d998e8a req-a77c36db-6117-4ce5-8f68-c0397e06c491 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032376 Apr 23 03:48:16 user devstack@n-api.service[61306]: [pid: 61306|app: 0|req: 40/121] 10.0.0.210 () {68 vars in 1394 bytes} [Sun Apr 23 03:48:16 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 23 03:48:18 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi [req-31582cc6-837a-43b7-82ee-4b2ff12c48e3 req-03806919-f5e2-414d-bc47-42c18fd13d91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08d906c5-1698-4c17-8430-c98f10836398", "name": "network-vif-deleted", "tag": "71dae390-2e66-4961-8ce7-1b8fff845732"}]} {{(pid=61308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 03:48:18 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [req-31582cc6-837a-43b7-82ee-4b2ff12c48e3 req-03806919-f5e2-414d-bc47-42c18fd13d91 service nova] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:48:18 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [req-31582cc6-837a-43b7-82ee-4b2ff12c48e3 req-03806919-f5e2-414d-bc47-42c18fd13d91 service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:48:18 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [req-31582cc6-837a-43b7-82ee-4b2ff12c48e3 req-03806919-f5e2-414d-bc47-42c18fd13d91 service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:48:18 user devstack@n-api.service[61308]: INFO nova.api.openstack.compute.server_external_events [req-31582cc6-837a-43b7-82ee-4b2ff12c48e3 req-03806919-f5e2-414d-bc47-42c18fd13d91 service nova] Creating event network-vif-deleted:71dae390-2e66-4961-8ce7-1b8fff845732 for instance 08d906c5-1698-4c17-8430-c98f10836398 on user Apr 23 03:48:18 user devstack@n-api.service[61308]: INFO nova.api.openstack.requestlog [req-31582cc6-837a-43b7-82ee-4b2ff12c48e3 req-03806919-f5e2-414d-bc47-42c18fd13d91 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.026868 Apr 23 03:48:18 user devstack@n-api.service[61308]: [pid: 61308|app: 0|req: 42/122] 10.0.0.210 () {68 vars in 1394 bytes} [Sun Apr 23 03:48:18 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 23 03:48:18 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi [req-3e315da1-825c-4447-8aae-f04361c8865e req-af9f4ffe-0da5-4b50-8a6e-6b75a20d0b4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08d906c5-1698-4c17-8430-c98f10836398", "name": "network-vif-plugged", "status": "completed", "tag": "71dae390-2e66-4961-8ce7-1b8fff845732"}, {"server_uuid": "08d906c5-1698-4c17-8430-c98f10836398", "name": "network-vif-plugged", "status": "completed", "tag": "71dae390-2e66-4961-8ce7-1b8fff845732"}, {"server_uuid": "08d906c5-1698-4c17-8430-c98f10836398", "name": "network-vif-plugged", "status": "completed", "tag": "71dae390-2e66-4961-8ce7-1b8fff845732"}, {"server_uuid": "08d906c5-1698-4c17-8430-c98f10836398", "name": "network-vif-unplugged", "status": "completed", "tag": "71dae390-2e66-4961-8ce7-1b8fff845732"}, {"server_uuid": "08d906c5-1698-4c17-8430-c98f10836398", "name": "network-vif-plugged", "status": "completed", "tag": "71dae390-2e66-4961-8ce7-1b8fff845732"}]} {{(pid=61307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 03:48:18 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [req-3e315da1-825c-4447-8aae-f04361c8865e req-af9f4ffe-0da5-4b50-8a6e-6b75a20d0b4c service nova] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:48:18 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [req-3e315da1-825c-4447-8aae-f04361c8865e req-af9f4ffe-0da5-4b50-8a6e-6b75a20d0b4c service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:48:18 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [req-3e315da1-825c-4447-8aae-f04361c8865e req-af9f4ffe-0da5-4b50-8a6e-6b75a20d0b4c service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:48:18 user devstack@n-api.service[61307]: INFO nova.api.openstack.compute.server_external_events [req-3e315da1-825c-4447-8aae-f04361c8865e req-af9f4ffe-0da5-4b50-8a6e-6b75a20d0b4c service nova] Creating event network-vif-plugged:71dae390-2e66-4961-8ce7-1b8fff845732 for instance 08d906c5-1698-4c17-8430-c98f10836398 on user Apr 23 03:48:18 user devstack@n-api.service[61307]: INFO nova.api.openstack.compute.server_external_events [req-3e315da1-825c-4447-8aae-f04361c8865e req-af9f4ffe-0da5-4b50-8a6e-6b75a20d0b4c service nova] Creating event network-vif-plugged:71dae390-2e66-4961-8ce7-1b8fff845732 for instance 08d906c5-1698-4c17-8430-c98f10836398 on user Apr 23 03:48:18 user devstack@n-api.service[61307]: INFO nova.api.openstack.compute.server_external_events [req-3e315da1-825c-4447-8aae-f04361c8865e req-af9f4ffe-0da5-4b50-8a6e-6b75a20d0b4c service nova] Creating event network-vif-plugged:71dae390-2e66-4961-8ce7-1b8fff845732 for instance 08d906c5-1698-4c17-8430-c98f10836398 on user Apr 23 03:48:18 user devstack@n-api.service[61307]: INFO nova.api.openstack.compute.server_external_events [req-3e315da1-825c-4447-8aae-f04361c8865e req-af9f4ffe-0da5-4b50-8a6e-6b75a20d0b4c service nova] Creating event network-vif-unplugged:71dae390-2e66-4961-8ce7-1b8fff845732 for instance 08d906c5-1698-4c17-8430-c98f10836398 on user Apr 23 03:48:18 user devstack@n-api.service[61307]: INFO nova.api.openstack.compute.server_external_events [req-3e315da1-825c-4447-8aae-f04361c8865e req-af9f4ffe-0da5-4b50-8a6e-6b75a20d0b4c service nova] Creating event network-vif-plugged:71dae390-2e66-4961-8ce7-1b8fff845732 for instance 08d906c5-1698-4c17-8430-c98f10836398 on user Apr 23 03:48:18 user devstack@n-api.service[61307]: INFO nova.api.openstack.requestlog [req-3e315da1-825c-4447-8aae-f04361c8865e req-af9f4ffe-0da5-4b50-8a6e-6b75a20d0b4c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 869 microversion: 2.1 time: 0.030808 Apr 23 03:48:18 user devstack@n-api.service[61307]: [pid: 61307|app: 0|req: 41/123] 10.0.0.210 () {68 vars in 1394 bytes} [Sun Apr 23 03:48:18 2023] POST /compute/v2.1/os-server-external-events => generated 869 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 23 03:48:24 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi [None req-ff5f03b6-5302-47ad-87a7-e45be36891bb tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] Calling method '>' {{(pid=61306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 03:48:24 user devstack@n-api.service[61306]: DEBUG nova.compute.api [None req-ff5f03b6-5302-47ad-87a7-e45be36891bb tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] [instance: 6f7cf091-3140-4746-bd1c-95c42ea82f6e] Fetching instance by UUID {{(pid=61306) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 23 03:48:24 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-ff5f03b6-5302-47ad-87a7-e45be36891bb tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:48:24 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-ff5f03b6-5302-47ad-87a7-e45be36891bb tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:48:24 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-ff5f03b6-5302-47ad-87a7-e45be36891bb tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:48:24 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-ff5f03b6-5302-47ad-87a7-e45be36891bb tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:48:24 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-ff5f03b6-5302-47ad-87a7-e45be36891bb tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:48:24 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-ff5f03b6-5302-47ad-87a7-e45be36891bb tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:48:25 user devstack@n-api.service[61306]: DEBUG nova.policy [None req-ff5f03b6-5302-47ad-87a7-e45be36891bb tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93a8dbfd8cef4578aff742813ffe901e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab0f01751954d04a83b360b2f839716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61306) authorize /opt/stack/nova/nova/policy.py:203}} Apr 23 03:48:25 user devstack@n-api.service[61306]: INFO nova.api.openstack.requestlog [None req-ff5f03b6-5302-47ad-87a7-e45be36891bb tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6f7cf091-3140-4746-bd1c-95c42ea82f6e" status: 200 len: 1537 microversion: 2.1 time: 0.229371 Apr 23 03:48:25 user devstack@n-api.service[61306]: [pid: 61306|app: 0|req: 41/124] 10.0.0.210 () {62 vars in 1313 bytes} [Sun Apr 23 03:48:24 2023] GET /compute/v2.1/servers/6f7cf091-3140-4746-bd1c-95c42ea82f6e => generated 1537 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 23 03:48:40 user devstack@n-api.service[61308]: DEBUG dbcounter [-] [61308] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=2 {{(pid=61308) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:48:40 user devstack@n-api.service[61308]: DEBUG dbcounter [-] [61308] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61308) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:48:40 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi [None req-1e497e15-c6d4-4049-ac64-dd17c87fcf28 tempest-AttachSCSIVolumeTestJSON-1319344340 tempest-AttachSCSIVolumeTestJSON-1319344340-project-member] Calling method '>' {{(pid=61308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 03:48:40 user devstack@n-api.service[61308]: DEBUG nova.compute.api [None req-1e497e15-c6d4-4049-ac64-dd17c87fcf28 tempest-AttachSCSIVolumeTestJSON-1319344340 tempest-AttachSCSIVolumeTestJSON-1319344340-project-member] [instance: ba71c9bf-4d96-4fdc-8a55-cbdc75c29e72] Fetching instance by UUID {{(pid=61308) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 23 03:48:40 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-1e497e15-c6d4-4049-ac64-dd17c87fcf28 tempest-AttachSCSIVolumeTestJSON-1319344340 tempest-AttachSCSIVolumeTestJSON-1319344340-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:48:40 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-1e497e15-c6d4-4049-ac64-dd17c87fcf28 tempest-AttachSCSIVolumeTestJSON-1319344340 tempest-AttachSCSIVolumeTestJSON-1319344340-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:48:40 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-1e497e15-c6d4-4049-ac64-dd17c87fcf28 tempest-AttachSCSIVolumeTestJSON-1319344340 tempest-AttachSCSIVolumeTestJSON-1319344340-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:48:40 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-1e497e15-c6d4-4049-ac64-dd17c87fcf28 tempest-AttachSCSIVolumeTestJSON-1319344340 tempest-AttachSCSIVolumeTestJSON-1319344340-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:48:40 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-1e497e15-c6d4-4049-ac64-dd17c87fcf28 tempest-AttachSCSIVolumeTestJSON-1319344340 tempest-AttachSCSIVolumeTestJSON-1319344340-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:48:40 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-1e497e15-c6d4-4049-ac64-dd17c87fcf28 tempest-AttachSCSIVolumeTestJSON-1319344340 tempest-AttachSCSIVolumeTestJSON-1319344340-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:48:41 user devstack@n-api.service[61308]: INFO nova.api.openstack.requestlog [None req-1e497e15-c6d4-4049-ac64-dd17c87fcf28 tempest-AttachSCSIVolumeTestJSON-1319344340 tempest-AttachSCSIVolumeTestJSON-1319344340-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ba71c9bf-4d96-4fdc-8a55-cbdc75c29e72/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.569791 Apr 23 03:48:41 user devstack@n-api.service[61308]: [pid: 61308|app: 0|req: 43/125] 10.0.0.210 () {62 vars in 1352 bytes} [Sun Apr 23 03:48:40 2023] GET /compute/v2.1/servers/ba71c9bf-4d96-4fdc-8a55-cbdc75c29e72/os-interface => generated 283 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 23 03:48:42 user devstack@n-api.service[61307]: DEBUG dbcounter [-] [61307] Writing DB stats nova_api:SELECT=12 {{(pid=61307) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:48:42 user devstack@n-api.service[61307]: DEBUG dbcounter [-] [61307] Writing DB stats nova_cell1:SELECT=33,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61307) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:48:42 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi [req-ccf8414c-31c5-4810-9dab-c597417a0c43 req-7ca24881-e088-4b41-8931-eea2e4216e48 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba71c9bf-4d96-4fdc-8a55-cbdc75c29e72", "tag": "3ba908e8-68cc-4bf7-be30-d5f6bbd0ff1a"}]} {{(pid=61307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 03:48:42 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [req-ccf8414c-31c5-4810-9dab-c597417a0c43 req-7ca24881-e088-4b41-8931-eea2e4216e48 service nova] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:48:42 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [req-ccf8414c-31c5-4810-9dab-c597417a0c43 req-7ca24881-e088-4b41-8931-eea2e4216e48 service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:48:42 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [req-ccf8414c-31c5-4810-9dab-c597417a0c43 req-7ca24881-e088-4b41-8931-eea2e4216e48 service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:48:42 user devstack@n-api.service[61307]: INFO nova.api.openstack.compute.server_external_events [req-ccf8414c-31c5-4810-9dab-c597417a0c43 req-7ca24881-e088-4b41-8931-eea2e4216e48 service nova] Creating event network-changed:3ba908e8-68cc-4bf7-be30-d5f6bbd0ff1a for instance ba71c9bf-4d96-4fdc-8a55-cbdc75c29e72 on user Apr 23 03:48:42 user devstack@n-api.service[61307]: INFO nova.api.openstack.requestlog [req-ccf8414c-31c5-4810-9dab-c597417a0c43 req-7ca24881-e088-4b41-8931-eea2e4216e48 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057486 Apr 23 03:48:42 user devstack@n-api.service[61307]: [pid: 61307|app: 0|req: 42/126] 10.0.0.210 () {68 vars in 1394 bytes} [Sun Apr 23 03:48:42 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 23 03:48:44 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi [None req-9cdefdf6-fd7f-48e1-a49f-a74ffd154a76 tempest-AttachSCSIVolumeTestJSON-1319344340 tempest-AttachSCSIVolumeTestJSON-1319344340-project-member] Calling method '>' {{(pid=61306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 03:48:44 user devstack@n-api.service[61306]: DEBUG nova.compute.api [None req-9cdefdf6-fd7f-48e1-a49f-a74ffd154a76 tempest-AttachSCSIVolumeTestJSON-1319344340 tempest-AttachSCSIVolumeTestJSON-1319344340-project-member] [instance: ba71c9bf-4d96-4fdc-8a55-cbdc75c29e72] Fetching instance by UUID {{(pid=61306) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 23 03:48:44 user devstack@n-api.service[61306]: DEBUG dbcounter [-] [61306] Writing DB stats nova_api:SELECT=12 {{(pid=61306) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:48:44 user devstack@n-api.service[61306]: DEBUG dbcounter [-] [61306] Writing DB stats nova_cell1:SELECT=28 {{(pid=61306) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:48:44 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-9cdefdf6-fd7f-48e1-a49f-a74ffd154a76 tempest-AttachSCSIVolumeTestJSON-1319344340 tempest-AttachSCSIVolumeTestJSON-1319344340-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:48:44 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-9cdefdf6-fd7f-48e1-a49f-a74ffd154a76 tempest-AttachSCSIVolumeTestJSON-1319344340 tempest-AttachSCSIVolumeTestJSON-1319344340-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:48:44 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-9cdefdf6-fd7f-48e1-a49f-a74ffd154a76 tempest-AttachSCSIVolumeTestJSON-1319344340 tempest-AttachSCSIVolumeTestJSON-1319344340-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:48:44 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-9cdefdf6-fd7f-48e1-a49f-a74ffd154a76 tempest-AttachSCSIVolumeTestJSON-1319344340 tempest-AttachSCSIVolumeTestJSON-1319344340-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:48:44 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-9cdefdf6-fd7f-48e1-a49f-a74ffd154a76 tempest-AttachSCSIVolumeTestJSON-1319344340 tempest-AttachSCSIVolumeTestJSON-1319344340-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:48:44 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-9cdefdf6-fd7f-48e1-a49f-a74ffd154a76 tempest-AttachSCSIVolumeTestJSON-1319344340 tempest-AttachSCSIVolumeTestJSON-1319344340-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:48:44 user devstack@n-api.service[61306]: DEBUG nova.compute.api [None req-9cdefdf6-fd7f-48e1-a49f-a74ffd154a76 tempest-AttachSCSIVolumeTestJSON-1319344340 tempest-AttachSCSIVolumeTestJSON-1319344340-project-member] [instance: ba71c9bf-4d96-4fdc-8a55-cbdc75c29e72] Going to try to terminate instance {{(pid=61306) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 23 03:48:44 user devstack@n-api.service[61306]: INFO nova.api.openstack.requestlog [None req-9cdefdf6-fd7f-48e1-a49f-a74ffd154a76 tempest-AttachSCSIVolumeTestJSON-1319344340 tempest-AttachSCSIVolumeTestJSON-1319344340-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/ba71c9bf-4d96-4fdc-8a55-cbdc75c29e72" status: 204 len: 0 microversion: 2.1 time: 0.405034 Apr 23 03:48:44 user devstack@n-api.service[61306]: [pid: 61306|app: 0|req: 42/127] 10.0.0.210 () {62 vars in 1316 bytes} [Sun Apr 23 03:48:44 2023] DELETE /compute/v2.1/servers/ba71c9bf-4d96-4fdc-8a55-cbdc75c29e72 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 23 03:48:44 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi [None req-407d228b-c10e-4f93-a814-ea6bb137d367 tempest-AttachSCSIVolumeTestJSON-1319344340 tempest-AttachSCSIVolumeTestJSON-1319344340-project-member] Calling method '>' {{(pid=61308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 03:48:44 user devstack@n-api.service[61308]: DEBUG nova.compute.api [None req-407d228b-c10e-4f93-a814-ea6bb137d367 tempest-AttachSCSIVolumeTestJSON-1319344340 tempest-AttachSCSIVolumeTestJSON-1319344340-project-member] [instance: ba71c9bf-4d96-4fdc-8a55-cbdc75c29e72] Fetching instance by UUID {{(pid=61308) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 23 03:48:44 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-407d228b-c10e-4f93-a814-ea6bb137d367 tempest-AttachSCSIVolumeTestJSON-1319344340 tempest-AttachSCSIVolumeTestJSON-1319344340-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:48:44 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-407d228b-c10e-4f93-a814-ea6bb137d367 tempest-AttachSCSIVolumeTestJSON-1319344340 tempest-AttachSCSIVolumeTestJSON-1319344340-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:48:44 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-407d228b-c10e-4f93-a814-ea6bb137d367 tempest-AttachSCSIVolumeTestJSON-1319344340 tempest-AttachSCSIVolumeTestJSON-1319344340-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:48:44 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-407d228b-c10e-4f93-a814-ea6bb137d367 tempest-AttachSCSIVolumeTestJSON-1319344340 tempest-AttachSCSIVolumeTestJSON-1319344340-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:48:44 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-407d228b-c10e-4f93-a814-ea6bb137d367 tempest-AttachSCSIVolumeTestJSON-1319344340 tempest-AttachSCSIVolumeTestJSON-1319344340-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:48:44 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-407d228b-c10e-4f93-a814-ea6bb137d367 tempest-AttachSCSIVolumeTestJSON-1319344340 tempest-AttachSCSIVolumeTestJSON-1319344340-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:48:44 user devstack@n-api.service[61308]: DEBUG nova.policy [None req-407d228b-c10e-4f93-a814-ea6bb137d367 tempest-AttachSCSIVolumeTestJSON-1319344340 tempest-AttachSCSIVolumeTestJSON-1319344340-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc51570d0e7c4617ac6b8fa428b9660f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f253a2e878a45d99dd3cbda86c0c6ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61308) authorize /opt/stack/nova/nova/policy.py:203}} Apr 23 03:48:44 user devstack@n-api.service[61308]: INFO nova.api.openstack.requestlog [None req-407d228b-c10e-4f93-a814-ea6bb137d367 tempest-AttachSCSIVolumeTestJSON-1319344340 tempest-AttachSCSIVolumeTestJSON-1319344340-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ba71c9bf-4d96-4fdc-8a55-cbdc75c29e72" status: 200 len: 1674 microversion: 2.1 time: 0.194723 Apr 23 03:48:44 user devstack@n-api.service[61308]: [pid: 61308|app: 0|req: 44/128] 10.0.0.210 () {62 vars in 1313 bytes} [Sun Apr 23 03:48:44 2023] GET /compute/v2.1/servers/ba71c9bf-4d96-4fdc-8a55-cbdc75c29e72 => generated 1674 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 23 03:48:44 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi [req-96002049-9b9e-4d05-8ddf-1f2d66a869e2 req-5e008153-2053-4f2b-86b6-b05fecd0382e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba71c9bf-4d96-4fdc-8a55-cbdc75c29e72", "name": "network-vif-unplugged", "status": "completed", "tag": "3ba908e8-68cc-4bf7-be30-d5f6bbd0ff1a"}]} {{(pid=61307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 03:48:44 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [req-96002049-9b9e-4d05-8ddf-1f2d66a869e2 req-5e008153-2053-4f2b-86b6-b05fecd0382e service nova] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:48:44 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [req-96002049-9b9e-4d05-8ddf-1f2d66a869e2 req-5e008153-2053-4f2b-86b6-b05fecd0382e service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:48:44 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [req-96002049-9b9e-4d05-8ddf-1f2d66a869e2 req-5e008153-2053-4f2b-86b6-b05fecd0382e service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:48:44 user devstack@n-api.service[61307]: INFO nova.api.openstack.compute.server_external_events [req-96002049-9b9e-4d05-8ddf-1f2d66a869e2 req-5e008153-2053-4f2b-86b6-b05fecd0382e service nova] Creating event network-vif-unplugged:3ba908e8-68cc-4bf7-be30-d5f6bbd0ff1a for instance ba71c9bf-4d96-4fdc-8a55-cbdc75c29e72 on user Apr 23 03:48:44 user devstack@n-api.service[61307]: INFO nova.api.openstack.requestlog [req-96002049-9b9e-4d05-8ddf-1f2d66a869e2 req-5e008153-2053-4f2b-86b6-b05fecd0382e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030892 Apr 23 03:48:44 user devstack@n-api.service[61307]: [pid: 61307|app: 0|req: 43/129] 10.0.0.210 () {68 vars in 1394 bytes} [Sun Apr 23 03:48:44 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 23 03:48:46 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi [req-034bf656-00db-4bb3-bc15-7ae4e9b34232 req-bf087ff5-3d25-4719-8fde-598f18dbeecf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba71c9bf-4d96-4fdc-8a55-cbdc75c29e72", "name": "network-vif-deleted", "tag": "3ba908e8-68cc-4bf7-be30-d5f6bbd0ff1a"}]} {{(pid=61306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 03:48:46 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [req-034bf656-00db-4bb3-bc15-7ae4e9b34232 req-bf087ff5-3d25-4719-8fde-598f18dbeecf service nova] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:48:46 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [req-034bf656-00db-4bb3-bc15-7ae4e9b34232 req-bf087ff5-3d25-4719-8fde-598f18dbeecf service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:48:46 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [req-034bf656-00db-4bb3-bc15-7ae4e9b34232 req-bf087ff5-3d25-4719-8fde-598f18dbeecf service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:48:46 user devstack@n-api.service[61306]: INFO nova.api.openstack.compute.server_external_events [req-034bf656-00db-4bb3-bc15-7ae4e9b34232 req-bf087ff5-3d25-4719-8fde-598f18dbeecf service nova] Creating event network-vif-deleted:3ba908e8-68cc-4bf7-be30-d5f6bbd0ff1a for instance ba71c9bf-4d96-4fdc-8a55-cbdc75c29e72 on user Apr 23 03:48:46 user devstack@n-api.service[61306]: INFO nova.api.openstack.requestlog [req-034bf656-00db-4bb3-bc15-7ae4e9b34232 req-bf087ff5-3d25-4719-8fde-598f18dbeecf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035731 Apr 23 03:48:46 user devstack@n-api.service[61306]: [pid: 61306|app: 0|req: 43/130] 10.0.0.210 () {68 vars in 1394 bytes} [Sun Apr 23 03:48:46 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 23 03:48:46 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi [req-2ab277be-c2f0-4ece-b3ae-37499eb6eae4 req-92685e2d-04b1-4fe0-ab50-f4ace3155b4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba71c9bf-4d96-4fdc-8a55-cbdc75c29e72", "name": "network-vif-plugged", "status": "completed", "tag": "3ba908e8-68cc-4bf7-be30-d5f6bbd0ff1a"}]} {{(pid=61308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 03:48:46 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [req-2ab277be-c2f0-4ece-b3ae-37499eb6eae4 req-92685e2d-04b1-4fe0-ab50-f4ace3155b4d service nova] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:48:46 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [req-2ab277be-c2f0-4ece-b3ae-37499eb6eae4 req-92685e2d-04b1-4fe0-ab50-f4ace3155b4d service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:48:46 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [req-2ab277be-c2f0-4ece-b3ae-37499eb6eae4 req-92685e2d-04b1-4fe0-ab50-f4ace3155b4d service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:48:46 user devstack@n-api.service[61308]: INFO nova.api.openstack.compute.server_external_events [req-2ab277be-c2f0-4ece-b3ae-37499eb6eae4 req-92685e2d-04b1-4fe0-ab50-f4ace3155b4d service nova] Creating event network-vif-plugged:3ba908e8-68cc-4bf7-be30-d5f6bbd0ff1a for instance ba71c9bf-4d96-4fdc-8a55-cbdc75c29e72 on user Apr 23 03:48:46 user devstack@n-api.service[61308]: INFO nova.api.openstack.requestlog [req-2ab277be-c2f0-4ece-b3ae-37499eb6eae4 req-92685e2d-04b1-4fe0-ab50-f4ace3155b4d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028709 Apr 23 03:48:46 user devstack@n-api.service[61308]: [pid: 61308|app: 0|req: 45/131] 10.0.0.210 () {68 vars in 1394 bytes} [Sun Apr 23 03:48:46 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 23 03:48:56 user devstack@n-api.service[61307]: DEBUG dbcounter [-] [61307] Writing DB stats nova_api:SELECT=4 {{(pid=61307) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:48:56 user devstack@n-api.service[61307]: DEBUG dbcounter [-] [61307] Writing DB stats nova_cell1:SELECT=4 {{(pid=61307) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:48:56 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi [None req-08fe6c70-9c2b-4dea-be6d-b53ed6c4446c tempest-DeleteServersTestJSON-2062396414 tempest-DeleteServersTestJSON-2062396414-project-member] Calling method '>' {{(pid=61307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 03:48:56 user devstack@n-api.service[61307]: DEBUG nova.compute.api [None req-08fe6c70-9c2b-4dea-be6d-b53ed6c4446c tempest-DeleteServersTestJSON-2062396414 tempest-DeleteServersTestJSON-2062396414-project-member] [instance: 56d8da41-3e04-465b-a1de-73d9e994682d] Fetching instance by UUID {{(pid=61307) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 23 03:48:56 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-08fe6c70-9c2b-4dea-be6d-b53ed6c4446c tempest-DeleteServersTestJSON-2062396414 tempest-DeleteServersTestJSON-2062396414-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:48:56 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-08fe6c70-9c2b-4dea-be6d-b53ed6c4446c tempest-DeleteServersTestJSON-2062396414 tempest-DeleteServersTestJSON-2062396414-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:48:56 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-08fe6c70-9c2b-4dea-be6d-b53ed6c4446c tempest-DeleteServersTestJSON-2062396414 tempest-DeleteServersTestJSON-2062396414-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:48:56 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-08fe6c70-9c2b-4dea-be6d-b53ed6c4446c tempest-DeleteServersTestJSON-2062396414 tempest-DeleteServersTestJSON-2062396414-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:48:56 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-08fe6c70-9c2b-4dea-be6d-b53ed6c4446c tempest-DeleteServersTestJSON-2062396414 tempest-DeleteServersTestJSON-2062396414-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:48:56 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-08fe6c70-9c2b-4dea-be6d-b53ed6c4446c tempest-DeleteServersTestJSON-2062396414 tempest-DeleteServersTestJSON-2062396414-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:48:56 user devstack@n-api.service[61307]: INFO nova.api.openstack.wsgi [None req-08fe6c70-9c2b-4dea-be6d-b53ed6c4446c tempest-DeleteServersTestJSON-2062396414 tempest-DeleteServersTestJSON-2062396414-project-member] HTTP exception thrown: Instance 56d8da41-3e04-465b-a1de-73d9e994682d could not be found. Apr 23 03:48:56 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi [None req-08fe6c70-9c2b-4dea-be6d-b53ed6c4446c tempest-DeleteServersTestJSON-2062396414 tempest-DeleteServersTestJSON-2062396414-project-member] Request method failure captured: Apr 23 03:48:56 user devstack@n-api.service[61307]: request: GET /compute/v2.1/servers/56d8da41-3e04-465b-a1de-73d9e994682d HTTP/1.1 Apr 23 03:48:56 user devstack@n-api.service[61307]: Accept: application/json Apr 23 03:48:56 user devstack@n-api.service[61307]: Accept-Encoding: identity Apr 23 03:48:56 user devstack@n-api.service[61307]: Connection: close Apr 23 03:48:56 user devstack@n-api.service[61307]: Content-Length: 0 Apr 23 03:48:56 user devstack@n-api.service[61307]: Content-Type: application/json Apr 23 03:48:56 user devstack@n-api.service[61307]: Host: 10.0.0.210 Apr 23 03:48:56 user devstack@n-api.service[61307]: Openstack-System-Scope: None Apr 23 03:48:56 user devstack@n-api.service[61307]: User-Agent: python-urllib3/1.26.15 Apr 23 03:48:56 user devstack@n-api.service[61307]: X-Auth-Token: gAAAAABkRKoC5_9qIgnEUcGZWbYzfkSOvhY-H8cavInlWIOpabhM9HSut7xgW0mQlQ69BfAZPe4L0HAGCDk9hI1t0N9FvJbGwhi8byF6Q8Eq0yTkt745Zj0zMG-H42R5EME-zBLHITUnUZ1FKzQQWCvh0PpcyHwttqvmDtT3XvcG5SQ3SOQREXQ Apr 23 03:48:56 user devstack@n-api.service[61307]: X-Domain-Id: None Apr 23 03:48:56 user devstack@n-api.service[61307]: X-Domain-Name: None Apr 23 03:48:56 user devstack@n-api.service[61307]: X-Identity-Status: Confirmed Apr 23 03:48:56 user devstack@n-api.service[61307]: X-Is-Admin-Project: True Apr 23 03:48:56 user devstack@n-api.service[61307]: X-Project-Domain-Id: default Apr 23 03:48:56 user devstack@n-api.service[61307]: X-Project-Domain-Name: Default Apr 23 03:48:56 user devstack@n-api.service[61307]: X-Project-Id: c4f91ccdb4da4cb4bc4b55b7ac2189f0 Apr 23 03:48:56 user devstack@n-api.service[61307]: X-Project-Name: tempest-DeleteServersTestJSON-2062396414 Apr 23 03:48:56 user devstack@n-api.service[61307]: X-Role: reader,member Apr 23 03:48:56 user devstack@n-api.service[61307]: X-Roles: reader,member Apr 23 03:48:56 user devstack@n-api.service[61307]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c4f91ccdb4da4cb4bc4b55b7ac2189f0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c4f91ccdb4da4cb4bc4b55b7ac2189f0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c4f91ccdb4da4cb4bc4b55b7ac2189f0"}]}] Apr 23 03:48:56 user devstack@n-api.service[61307]: X-Tenant: tempest-DeleteServersTestJSON-2062396414 Apr 23 03:48:56 user devstack@n-api.service[61307]: X-Tenant-Id: c4f91ccdb4da4cb4bc4b55b7ac2189f0 Apr 23 03:48:56 user devstack@n-api.service[61307]: X-Tenant-Name: tempest-DeleteServersTestJSON-2062396414 Apr 23 03:48:56 user devstack@n-api.service[61307]: X-User: tempest-DeleteServersTestJSON-2062396414-project-member Apr 23 03:48:56 user devstack@n-api.service[61307]: X-User-Domain-Id: default Apr 23 03:48:56 user devstack@n-api.service[61307]: X-User-Domain-Name: Default Apr 23 03:48:56 user devstack@n-api.service[61307]: X-User-Id: 4e6ddab9797c449d85bf6f3a241473e0 Apr 23 03:48:56 user devstack@n-api.service[61307]: X-User-Name: tempest-DeleteServersTestJSON-2062396414-project-member Apr 23 03:48:56 user devstack@n-api.service[61307]: method: > Apr 23 03:48:56 user devstack@n-api.service[61307]: exception: Instance 56d8da41-3e04-465b-a1de-73d9e994682d could not be found. Apr 23 03:48:56 user devstack@n-api.service[61307]: action_args: {'id': '56d8da41-3e04-465b-a1de-73d9e994682d'} Apr 23 03:48:56 user devstack@n-api.service[61307]: {{(pid=61307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 23 03:48:56 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 23 03:48:56 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 23 03:48:56 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 23 03:48:56 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 23 03:48:56 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 23 03:48:56 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 23 03:48:56 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 23 03:48:56 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 23 03:48:56 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 23 03:48:56 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 56d8da41-3e04-465b-a1de-73d9e994682d could not be found. Apr 23 03:48:56 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi Apr 23 03:48:56 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 23 03:48:56 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi Apr 23 03:48:56 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 23 03:48:56 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 23 03:48:56 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 23 03:48:56 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 23 03:48:56 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 23 03:48:56 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 23 03:48:56 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 23 03:48:56 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 23 03:48:56 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 23 03:48:56 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 23 03:48:56 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 23 03:48:56 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 23 03:48:56 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 23 03:48:56 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 56d8da41-3e04-465b-a1de-73d9e994682d could not be found. Apr 23 03:48:56 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi Apr 23 03:48:56 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 23 03:48:56 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi Apr 23 03:48:56 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 23 03:48:56 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 23 03:48:56 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 23 03:48:56 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 23 03:48:56 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 23 03:48:56 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 56d8da41-3e04-465b-a1de-73d9e994682d could not be found. Apr 23 03:48:56 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi Apr 23 03:48:56 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi [None req-08fe6c70-9c2b-4dea-be6d-b53ed6c4446c tempest-DeleteServersTestJSON-2062396414 tempest-DeleteServersTestJSON-2062396414-project-member] Returning 404 to user: Instance 56d8da41-3e04-465b-a1de-73d9e994682d could not be found. {{(pid=61307) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 23 03:48:56 user devstack@n-api.service[61307]: INFO nova.api.openstack.requestlog [None req-08fe6c70-9c2b-4dea-be6d-b53ed6c4446c tempest-DeleteServersTestJSON-2062396414 tempest-DeleteServersTestJSON-2062396414-project-member] 10.0.0.210 "GET /compute/v2.1/servers/56d8da41-3e04-465b-a1de-73d9e994682d" status: 404 len: 111 microversion: 2.1 time: 0.036460 Apr 23 03:48:56 user devstack@n-api.service[61307]: [pid: 61307|app: 0|req: 44/132] 10.0.0.210 () {62 vars in 1313 bytes} [Sun Apr 23 03:48:56 2023] GET /compute/v2.1/servers/56d8da41-3e04-465b-a1de-73d9e994682d => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 23 03:48:58 user devstack@n-api.service[61306]: DEBUG dbcounter [-] [61306] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61306) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:48:58 user devstack@n-api.service[61306]: DEBUG dbcounter [-] [61306] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61306) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:48:58 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi [None req-0a75bbc2-4448-47a1-94ba-ac8aee5fbc9c tempest-ServerStableDeviceRescueTest-847110386 tempest-ServerStableDeviceRescueTest-847110386-project-member] Calling method '.version_select at 0x7f21e14e7520>' {{(pid=61306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 03:48:58 user devstack@n-api.service[61306]: INFO nova.api.openstack.requestlog [None req-0a75bbc2-4448-47a1-94ba-ac8aee5fbc9c tempest-ServerStableDeviceRescueTest-847110386 tempest-ServerStableDeviceRescueTest-847110386-project-member] 10.0.0.210 "GET /compute/v2.1/images/ed2ff9e4-bed2-49af-99bb-51a7c0bfa96f" status: 200 len: 1723 microversion: 2.1 time: 0.061596 Apr 23 03:48:58 user devstack@n-api.service[61306]: [pid: 61306|app: 0|req: 44/133] 10.0.0.210 () {62 vars in 1310 bytes} [Sun Apr 23 03:48:58 2023] GET /compute/v2.1/images/ed2ff9e4-bed2-49af-99bb-51a7c0bfa96f => generated 1723 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 23 03:48:58 user devstack@n-api.service[61308]: DEBUG dbcounter [-] [61308] Writing DB stats nova_api:SELECT=6 {{(pid=61308) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:48:58 user devstack@n-api.service[61308]: DEBUG dbcounter [-] [61308] Writing DB stats nova_cell1:SELECT=12 {{(pid=61308) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:48:58 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi [None req-f4cf2ab3-5d1c-45c8-84fc-7edcc88337a8 tempest-ServerStableDeviceRescueTest-847110386 tempest-ServerStableDeviceRescueTest-847110386-project-member] Calling method '.version_select at 0x7f21e1435000>' {{(pid=61308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 03:48:58 user devstack@n-api.service[61308]: INFO nova.api.openstack.requestlog [None req-f4cf2ab3-5d1c-45c8-84fc-7edcc88337a8 tempest-ServerStableDeviceRescueTest-847110386 tempest-ServerStableDeviceRescueTest-847110386-project-member] 10.0.0.210 "GET /compute/v2.1/images/ed2ff9e4-bed2-49af-99bb-51a7c0bfa96f" status: 200 len: 1723 microversion: 2.1 time: 0.063002 Apr 23 03:48:58 user devstack@n-api.service[61308]: [pid: 61308|app: 0|req: 46/134] 10.0.0.210 () {62 vars in 1310 bytes} [Sun Apr 23 03:48:58 2023] GET /compute/v2.1/images/ed2ff9e4-bed2-49af-99bb-51a7c0bfa96f => generated 1723 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 23 03:48:58 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi [None req-bc66022e-ced1-40fa-8488-3f2ed0631410 tempest-ServerStableDeviceRescueTest-847110386 tempest-ServerStableDeviceRescueTest-847110386-project-member] Calling method '>' {{(pid=61307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 03:48:58 user devstack@n-api.service[61307]: DEBUG nova.compute.api [None req-bc66022e-ced1-40fa-8488-3f2ed0631410 tempest-ServerStableDeviceRescueTest-847110386 tempest-ServerStableDeviceRescueTest-847110386-project-member] [instance: f279f3d3-581d-4d6f-924f-4104ec23832a] Fetching instance by UUID {{(pid=61307) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 23 03:48:58 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-bc66022e-ced1-40fa-8488-3f2ed0631410 tempest-ServerStableDeviceRescueTest-847110386 tempest-ServerStableDeviceRescueTest-847110386-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:48:58 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-bc66022e-ced1-40fa-8488-3f2ed0631410 tempest-ServerStableDeviceRescueTest-847110386 tempest-ServerStableDeviceRescueTest-847110386-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:48:58 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-bc66022e-ced1-40fa-8488-3f2ed0631410 tempest-ServerStableDeviceRescueTest-847110386 tempest-ServerStableDeviceRescueTest-847110386-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:48:58 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-bc66022e-ced1-40fa-8488-3f2ed0631410 tempest-ServerStableDeviceRescueTest-847110386 tempest-ServerStableDeviceRescueTest-847110386-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:48:58 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-bc66022e-ced1-40fa-8488-3f2ed0631410 tempest-ServerStableDeviceRescueTest-847110386 tempest-ServerStableDeviceRescueTest-847110386-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:48:58 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-bc66022e-ced1-40fa-8488-3f2ed0631410 tempest-ServerStableDeviceRescueTest-847110386 tempest-ServerStableDeviceRescueTest-847110386-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:48:58 user devstack@n-api.service[61307]: DEBUG nova.policy [None req-bc66022e-ced1-40fa-8488-3f2ed0631410 tempest-ServerStableDeviceRescueTest-847110386 tempest-ServerStableDeviceRescueTest-847110386-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3311b6ae249f41269fde041f6e441840', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5864626fffa7443c800b244471966d65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61307) authorize /opt/stack/nova/nova/policy.py:203}} Apr 23 03:48:58 user devstack@n-api.service[61307]: INFO nova.api.openstack.requestlog [None req-bc66022e-ced1-40fa-8488-3f2ed0631410 tempest-ServerStableDeviceRescueTest-847110386 tempest-ServerStableDeviceRescueTest-847110386-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f279f3d3-581d-4d6f-924f-4104ec23832a" status: 200 len: 1670 microversion: 2.1 time: 0.359306 Apr 23 03:48:58 user devstack@n-api.service[61307]: [pid: 61307|app: 0|req: 45/135] 10.0.0.210 () {62 vars in 1313 bytes} [Sun Apr 23 03:48:58 2023] GET /compute/v2.1/servers/f279f3d3-581d-4d6f-924f-4104ec23832a => generated 1670 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 23 03:49:06 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi [None req-68a1e19c-c638-439a-942d-c6a10ccb35f0 tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] Calling method '>' {{(pid=61306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 03:49:06 user devstack@n-api.service[61306]: DEBUG nova.compute.api [None req-68a1e19c-c638-439a-942d-c6a10ccb35f0 tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] [instance: 08d906c5-1698-4c17-8430-c98f10836398] Fetching instance by UUID {{(pid=61306) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 23 03:49:06 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-68a1e19c-c638-439a-942d-c6a10ccb35f0 tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:49:06 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-68a1e19c-c638-439a-942d-c6a10ccb35f0 tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:49:06 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-68a1e19c-c638-439a-942d-c6a10ccb35f0 tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:49:06 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-68a1e19c-c638-439a-942d-c6a10ccb35f0 tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:49:06 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-68a1e19c-c638-439a-942d-c6a10ccb35f0 tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:49:06 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-68a1e19c-c638-439a-942d-c6a10ccb35f0 tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:49:06 user devstack@n-api.service[61306]: INFO nova.api.openstack.wsgi [None req-68a1e19c-c638-439a-942d-c6a10ccb35f0 tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] HTTP exception thrown: Instance 08d906c5-1698-4c17-8430-c98f10836398 could not be found. Apr 23 03:49:06 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi [None req-68a1e19c-c638-439a-942d-c6a10ccb35f0 tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] Request method failure captured: Apr 23 03:49:06 user devstack@n-api.service[61306]: request: GET /compute/v2.1/servers/08d906c5-1698-4c17-8430-c98f10836398 HTTP/1.1 Apr 23 03:49:06 user devstack@n-api.service[61306]: Accept: application/json Apr 23 03:49:06 user devstack@n-api.service[61306]: Accept-Encoding: identity Apr 23 03:49:06 user devstack@n-api.service[61306]: Connection: close Apr 23 03:49:06 user devstack@n-api.service[61306]: Content-Length: 0 Apr 23 03:49:06 user devstack@n-api.service[61306]: Content-Type: application/json Apr 23 03:49:06 user devstack@n-api.service[61306]: Host: 10.0.0.210 Apr 23 03:49:06 user devstack@n-api.service[61306]: Openstack-System-Scope: None Apr 23 03:49:06 user devstack@n-api.service[61306]: User-Agent: python-urllib3/1.26.15 Apr 23 03:49:06 user devstack@n-api.service[61306]: X-Auth-Token: gAAAAABkRKoEHslY58NoapplHv096IIemOcJ2uEL5fg5YnsrIN7vEVe0goC2-fhyT-4hwLklX7U-s1WIYv72E0xvN5TVTtH79X_fujgCXOgwUZcOoajDGkzv6NTcV4kTMtcgQuvKnfzUIN9o6o81Rg7rqi8gYyC-7qPK6BIPOMDOMMURsNRPwDw Apr 23 03:49:06 user devstack@n-api.service[61306]: X-Domain-Id: None Apr 23 03:49:06 user devstack@n-api.service[61306]: X-Domain-Name: None Apr 23 03:49:06 user devstack@n-api.service[61306]: X-Identity-Status: Confirmed Apr 23 03:49:06 user devstack@n-api.service[61306]: X-Is-Admin-Project: True Apr 23 03:49:06 user devstack@n-api.service[61306]: X-Project-Domain-Id: default Apr 23 03:49:06 user devstack@n-api.service[61306]: X-Project-Domain-Name: Default Apr 23 03:49:06 user devstack@n-api.service[61306]: X-Project-Id: 70b031ddc5c94ca98e7161de03bda4b7 Apr 23 03:49:06 user devstack@n-api.service[61306]: X-Project-Name: tempest-AttachVolumeTestJSON-276721084 Apr 23 03:49:06 user devstack@n-api.service[61306]: X-Role: reader,member Apr 23 03:49:06 user devstack@n-api.service[61306]: X-Roles: reader,member Apr 23 03:49:06 user devstack@n-api.service[61306]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/70b031ddc5c94ca98e7161de03bda4b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/70b031ddc5c94ca98e7161de03bda4b7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/70b031ddc5c94ca98e7161de03bda4b7"}]}] Apr 23 03:49:06 user devstack@n-api.service[61306]: X-Tenant: tempest-AttachVolumeTestJSON-276721084 Apr 23 03:49:06 user devstack@n-api.service[61306]: X-Tenant-Id: 70b031ddc5c94ca98e7161de03bda4b7 Apr 23 03:49:06 user devstack@n-api.service[61306]: X-Tenant-Name: tempest-AttachVolumeTestJSON-276721084 Apr 23 03:49:06 user devstack@n-api.service[61306]: X-User: tempest-AttachVolumeTestJSON-276721084-project-member Apr 23 03:49:06 user devstack@n-api.service[61306]: X-User-Domain-Id: default Apr 23 03:49:06 user devstack@n-api.service[61306]: X-User-Domain-Name: Default Apr 23 03:49:06 user devstack@n-api.service[61306]: X-User-Id: e3d689f1c160478ca83bbff3104d8ec3 Apr 23 03:49:06 user devstack@n-api.service[61306]: X-User-Name: tempest-AttachVolumeTestJSON-276721084-project-member Apr 23 03:49:06 user devstack@n-api.service[61306]: method: > Apr 23 03:49:06 user devstack@n-api.service[61306]: exception: Instance 08d906c5-1698-4c17-8430-c98f10836398 could not be found. Apr 23 03:49:06 user devstack@n-api.service[61306]: action_args: {'id': '08d906c5-1698-4c17-8430-c98f10836398'} Apr 23 03:49:06 user devstack@n-api.service[61306]: {{(pid=61306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 23 03:49:06 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 23 03:49:06 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 23 03:49:06 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 23 03:49:06 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 23 03:49:06 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 23 03:49:06 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 23 03:49:06 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 23 03:49:06 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 23 03:49:06 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 23 03:49:06 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08d906c5-1698-4c17-8430-c98f10836398 could not be found. Apr 23 03:49:06 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi Apr 23 03:49:06 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 23 03:49:06 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi Apr 23 03:49:06 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 23 03:49:06 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 23 03:49:06 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 23 03:49:06 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 23 03:49:06 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 23 03:49:06 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 23 03:49:06 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 23 03:49:06 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 23 03:49:06 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 23 03:49:06 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 23 03:49:06 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 23 03:49:06 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 23 03:49:06 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 23 03:49:06 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08d906c5-1698-4c17-8430-c98f10836398 could not be found. Apr 23 03:49:06 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi Apr 23 03:49:06 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 23 03:49:06 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi Apr 23 03:49:06 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 23 03:49:06 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 23 03:49:06 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 23 03:49:06 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 23 03:49:06 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 23 03:49:06 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08d906c5-1698-4c17-8430-c98f10836398 could not be found. Apr 23 03:49:06 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi Apr 23 03:49:06 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi [None req-68a1e19c-c638-439a-942d-c6a10ccb35f0 tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] Returning 404 to user: Instance 08d906c5-1698-4c17-8430-c98f10836398 could not be found. {{(pid=61306) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 23 03:49:06 user devstack@n-api.service[61306]: INFO nova.api.openstack.requestlog [None req-68a1e19c-c638-439a-942d-c6a10ccb35f0 tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] 10.0.0.210 "GET /compute/v2.1/servers/08d906c5-1698-4c17-8430-c98f10836398" status: 404 len: 111 microversion: 2.1 time: 0.033498 Apr 23 03:49:06 user devstack@n-api.service[61306]: [pid: 61306|app: 0|req: 45/136] 10.0.0.210 () {62 vars in 1313 bytes} [Sun Apr 23 03:49:06 2023] GET /compute/v2.1/servers/08d906c5-1698-4c17-8430-c98f10836398 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 23 03:49:06 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi [None req-7e30c70b-2b17-4916-875e-842a9e1784a6 tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] Calling method '.version_select at 0x7f21e1435630>' {{(pid=61308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 03:49:06 user devstack@n-api.service[61308]: INFO nova.api.openstack.requestlog [None req-7e30c70b-2b17-4916-875e-842a9e1784a6 tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1821880172" status: 202 len: 0 microversion: 2.1 time: 0.021984 Apr 23 03:49:06 user devstack@n-api.service[61308]: [pid: 61308|app: 0|req: 47/137] 10.0.0.210 () {62 vars in 1298 bytes} [Sun Apr 23 03:49:06 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1821880172 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 23 03:49:06 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi [None req-2a116d4e-8cf4-4761-aa53-ebe6cc43c9ad tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-2136327616", "imageRef": "e6127373-9931-4277-9458-eceef653ea1e", "flavorRef": "42", "networks": [{"uuid": "25de9e6c-4c02-4658-b076-466681d96605"}]}} {{(pid=61307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 03:49:06 user devstack@n-api.service[61307]: DEBUG nova.network.neutron [None req-2a116d4e-8cf4-4761-aa53-ebe6cc43c9ad tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] validate_networks() for [('25de9e6c-4c02-4658-b076-466681d96605', None, None, None, None, None)] {{(pid=61307) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 23 03:49:07 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi [None req-44a6e420-b5ba-4949-9f3f-491a7a5e9153 tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] Calling method '>' {{(pid=61306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 03:49:07 user devstack@n-api.service[61306]: DEBUG nova.compute.api [None req-44a6e420-b5ba-4949-9f3f-491a7a5e9153 tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] [instance: 954f41b2-5c67-41a4-b38b-ebf3ad60cac7] Fetching instance by UUID {{(pid=61306) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 23 03:49:07 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-44a6e420-b5ba-4949-9f3f-491a7a5e9153 tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:49:07 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-44a6e420-b5ba-4949-9f3f-491a7a5e9153 tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:49:07 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-44a6e420-b5ba-4949-9f3f-491a7a5e9153 tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:49:07 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi [None req-964b3a36-efc9-4527-aaa3-7db317af9625 tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] Action: 'create', calling method: .version_select at 0x7f21e1f75b40>, body: {"keypair": {"name": "tempest-keypair-1779422949", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKEbelubDhWYxOcMjX0yw/rKDeobxDpM94ii4rSjeoKkqXPZBE/gk0LSlgoNggx8xKW/qBeJcmHECpzHOVf8zkPxD/oth6aCuNZeiupH6KLcLo/umHtjWJDWCvB+mcrBEQ=="}} {{(pid=61308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 03:49:07 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-44a6e420-b5ba-4949-9f3f-491a7a5e9153 tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:49:07 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-44a6e420-b5ba-4949-9f3f-491a7a5e9153 tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:49:07 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-44a6e420-b5ba-4949-9f3f-491a7a5e9153 tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:49:07 user devstack@n-api.service[61308]: DEBUG nova.quota [None req-964b3a36-efc9-4527-aaa3-7db317af9625 tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] Getting quotas for project 70b031ddc5c94ca98e7161de03bda4b7. Resources: {'key_pairs'} {{(pid=61308) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 23 03:49:07 user devstack@n-api.service[61308]: DEBUG nova.quota [None req-964b3a36-efc9-4527-aaa3-7db317af9625 tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] Getting quotas for user e3d689f1c160478ca83bbff3104d8ec3 and project 70b031ddc5c94ca98e7161de03bda4b7. Resources: {'key_pairs'} {{(pid=61308) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 23 03:49:07 user devstack@n-api.service[61308]: INFO nova.api.openstack.requestlog [None req-964b3a36-efc9-4527-aaa3-7db317af9625 tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.046270 Apr 23 03:49:07 user devstack@n-api.service[61308]: [pid: 61308|app: 0|req: 48/138] 10.0.0.210 () {64 vars in 1236 bytes} [Sun Apr 23 03:49:07 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 23 03:49:07 user devstack@n-api.service[61306]: INFO nova.api.openstack.requestlog [None req-44a6e420-b5ba-4949-9f3f-491a7a5e9153 tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] 10.0.0.210 "GET /compute/v2.1/servers/954f41b2-5c67-41a4-b38b-ebf3ad60cac7/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.160789 Apr 23 03:49:07 user devstack@n-api.service[61306]: [pid: 61306|app: 0|req: 46/139] 10.0.0.210 () {62 vars in 1352 bytes} [Sun Apr 23 03:49:07 2023] GET /compute/v2.1/servers/954f41b2-5c67-41a4-b38b-ebf3ad60cac7/os-interface => generated 282 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 23 03:49:07 user devstack@n-api.service[61307]: DEBUG nova.virt.hardware [None req-2a116d4e-8cf4-4761-aa53-ebe6cc43c9ad tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Flavor limits 0:0:0 {{(pid=61307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 23 03:49:07 user devstack@n-api.service[61307]: DEBUG nova.virt.hardware [None req-2a116d4e-8cf4-4761-aa53-ebe6cc43c9ad tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Image limits 0:0:0 {{(pid=61307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 23 03:49:07 user devstack@n-api.service[61307]: DEBUG nova.virt.hardware [None req-2a116d4e-8cf4-4761-aa53-ebe6cc43c9ad tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Flavor pref 0:0:0 {{(pid=61307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 23 03:49:07 user devstack@n-api.service[61307]: DEBUG nova.virt.hardware [None req-2a116d4e-8cf4-4761-aa53-ebe6cc43c9ad tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Image pref 0:0:0 {{(pid=61307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 23 03:49:07 user devstack@n-api.service[61307]: DEBUG nova.virt.hardware [None req-2a116d4e-8cf4-4761-aa53-ebe6cc43c9ad tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 23 03:49:07 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-2a116d4e-8cf4-4761-aa53-ebe6cc43c9ad tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:49:07 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-2a116d4e-8cf4-4761-aa53-ebe6cc43c9ad tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:49:07 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-2a116d4e-8cf4-4761-aa53-ebe6cc43c9ad tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:49:07 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-2a116d4e-8cf4-4761-aa53-ebe6cc43c9ad tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:49:07 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-2a116d4e-8cf4-4761-aa53-ebe6cc43c9ad tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:49:07 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-2a116d4e-8cf4-4761-aa53-ebe6cc43c9ad tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:49:07 user devstack@n-api.service[61307]: DEBUG nova.quota [None req-2a116d4e-8cf4-4761-aa53-ebe6cc43c9ad tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Getting quotas for project a79e09b1c4ae4cc5ab11c3e56ee4f0d9. Resources: {'ram', 'instances', 'cores'} {{(pid=61307) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 23 03:49:07 user devstack@n-api.service[61307]: DEBUG nova.quota [None req-2a116d4e-8cf4-4761-aa53-ebe6cc43c9ad tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Getting quotas for user 99495726467944c38620831fc93e2856 and project a79e09b1c4ae4cc5ab11c3e56ee4f0d9. Resources: {'ram', 'instances', 'cores'} {{(pid=61307) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 23 03:49:07 user devstack@n-api.service[61307]: DEBUG nova.compute.api [None req-2a116d4e-8cf4-4761-aa53-ebe6cc43c9ad tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Going to run 1 instances... {{(pid=61307) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 23 03:49:07 user devstack@n-api.service[61307]: DEBUG nova.compute.api [None req-2a116d4e-8cf4-4761-aa53-ebe6cc43c9ad tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] [instance: c8480a7c-b5de-4f66-a4f0-08fc679b0dfd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e6127373-9931-4277-9458-eceef653ea1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61307) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 23 03:49:07 user devstack@n-api.service[61307]: INFO nova.api.openstack.requestlog [None req-2a116d4e-8cf4-4761-aa53-ebe6cc43c9ad tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.686626 Apr 23 03:49:07 user devstack@n-api.service[61307]: [pid: 61307|app: 0|req: 46/140] 10.0.0.210 () {66 vars in 1265 bytes} [Sun Apr 23 03:49:06 2023] POST /compute/v2.1/servers => generated 378 bytes in 690 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 23 03:49:07 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi [None req-dc857c3c-ad21-4b6f-acc5-bbae5d1889f0 tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Calling method '>' {{(pid=61308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 03:49:07 user devstack@n-api.service[61308]: DEBUG nova.compute.api [None req-dc857c3c-ad21-4b6f-acc5-bbae5d1889f0 tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] [instance: c8480a7c-b5de-4f66-a4f0-08fc679b0dfd] Fetching instance by UUID {{(pid=61308) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 23 03:49:07 user devstack@n-api.service[61308]: DEBUG nova.policy [None req-dc857c3c-ad21-4b6f-acc5-bbae5d1889f0 tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99495726467944c38620831fc93e2856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79e09b1c4ae4cc5ab11c3e56ee4f0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61308) authorize /opt/stack/nova/nova/policy.py:203}} Apr 23 03:49:07 user devstack@n-api.service[61308]: DEBUG nova.policy [None req-dc857c3c-ad21-4b6f-acc5-bbae5d1889f0 tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99495726467944c38620831fc93e2856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79e09b1c4ae4cc5ab11c3e56ee4f0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61308) authorize /opt/stack/nova/nova/policy.py:203}} Apr 23 03:49:07 user devstack@n-api.service[61308]: DEBUG nova.policy [None req-dc857c3c-ad21-4b6f-acc5-bbae5d1889f0 tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99495726467944c38620831fc93e2856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79e09b1c4ae4cc5ab11c3e56ee4f0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61308) authorize /opt/stack/nova/nova/policy.py:203}} Apr 23 03:49:07 user devstack@n-api.service[61308]: INFO nova.api.openstack.requestlog [None req-dc857c3c-ad21-4b6f-acc5-bbae5d1889f0 tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c8480a7c-b5de-4f66-a4f0-08fc679b0dfd" status: 200 len: 1395 microversion: 2.87 time: 0.071020 Apr 23 03:49:07 user devstack@n-api.service[61308]: [pid: 61308|app: 0|req: 49/141] 10.0.0.210 () {64 vars in 1354 bytes} [Sun Apr 23 03:49:07 2023] GET /compute/v2.1/servers/c8480a7c-b5de-4f66-a4f0-08fc679b0dfd => generated 1395 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 23 03:49:07 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi [None req-153293c1-823b-4cce-9673-f381ef7e641a tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Calling method '>' {{(pid=61306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 03:49:07 user devstack@n-api.service[61306]: DEBUG nova.compute.api [None req-153293c1-823b-4cce-9673-f381ef7e641a tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] [instance: 3ec36a95-88ce-4ed1-9726-7e6d98674dec] Fetching instance by UUID {{(pid=61306) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 23 03:49:07 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-153293c1-823b-4cce-9673-f381ef7e641a tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:49:07 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-153293c1-823b-4cce-9673-f381ef7e641a tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:49:07 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-153293c1-823b-4cce-9673-f381ef7e641a tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:49:07 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-153293c1-823b-4cce-9673-f381ef7e641a tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:49:07 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-153293c1-823b-4cce-9673-f381ef7e641a tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:49:07 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-153293c1-823b-4cce-9673-f381ef7e641a tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:49:07 user devstack@n-api.service[61306]: INFO nova.api.openstack.requestlog [None req-153293c1-823b-4cce-9673-f381ef7e641a tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3ec36a95-88ce-4ed1-9726-7e6d98674dec/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.154460 Apr 23 03:49:07 user devstack@n-api.service[61306]: [pid: 61306|app: 0|req: 47/142] 10.0.0.210 () {62 vars in 1352 bytes} [Sun Apr 23 03:49:07 2023] GET /compute/v2.1/servers/3ec36a95-88ce-4ed1-9726-7e6d98674dec/os-interface => generated 282 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 23 03:49:08 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi [req-d9a5d101-d766-425f-8c94-00786ceab719 req-4a39f113-fba7-4965-94e1-ea947038072f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ec36a95-88ce-4ed1-9726-7e6d98674dec", "tag": "af57258e-69b3-405b-a9f6-8d54c1810960"}]} {{(pid=61307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 03:49:08 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [req-d9a5d101-d766-425f-8c94-00786ceab719 req-4a39f113-fba7-4965-94e1-ea947038072f service nova] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:49:08 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [req-d9a5d101-d766-425f-8c94-00786ceab719 req-4a39f113-fba7-4965-94e1-ea947038072f service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:49:08 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [req-d9a5d101-d766-425f-8c94-00786ceab719 req-4a39f113-fba7-4965-94e1-ea947038072f service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:49:08 user devstack@n-api.service[61307]: INFO nova.api.openstack.compute.server_external_events [req-d9a5d101-d766-425f-8c94-00786ceab719 req-4a39f113-fba7-4965-94e1-ea947038072f service nova] Creating event network-changed:af57258e-69b3-405b-a9f6-8d54c1810960 for instance 3ec36a95-88ce-4ed1-9726-7e6d98674dec on user Apr 23 03:49:08 user devstack@n-api.service[61307]: INFO nova.api.openstack.requestlog [req-d9a5d101-d766-425f-8c94-00786ceab719 req-4a39f113-fba7-4965-94e1-ea947038072f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055087 Apr 23 03:49:08 user devstack@n-api.service[61307]: [pid: 61307|app: 0|req: 47/143] 10.0.0.210 () {68 vars in 1394 bytes} [Sun Apr 23 03:49:08 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 23 03:49:08 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi [None req-b664e286-03be-438d-bfd5-76efc032cdf2 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Calling method '>' {{(pid=61308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 03:49:08 user devstack@n-api.service[61308]: DEBUG nova.compute.api [None req-b664e286-03be-438d-bfd5-76efc032cdf2 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] [instance: 3ec36a95-88ce-4ed1-9726-7e6d98674dec] Fetching instance by UUID {{(pid=61308) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 23 03:49:08 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-b664e286-03be-438d-bfd5-76efc032cdf2 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:49:08 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-b664e286-03be-438d-bfd5-76efc032cdf2 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:49:08 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-b664e286-03be-438d-bfd5-76efc032cdf2 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:49:08 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-b664e286-03be-438d-bfd5-76efc032cdf2 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:49:08 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-b664e286-03be-438d-bfd5-76efc032cdf2 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:49:08 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-b664e286-03be-438d-bfd5-76efc032cdf2 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:49:08 user devstack@n-api.service[61308]: INFO nova.api.openstack.requestlog [None req-b664e286-03be-438d-bfd5-76efc032cdf2 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3ec36a95-88ce-4ed1-9726-7e6d98674dec/ips" status: 200 len: 107 microversion: 2.1 time: 0.034567 Apr 23 03:49:08 user devstack@n-api.service[61308]: [pid: 61308|app: 0|req: 50/144] 10.0.0.210 () {62 vars in 1325 bytes} [Sun Apr 23 03:49:08 2023] GET /compute/v2.1/servers/3ec36a95-88ce-4ed1-9726-7e6d98674dec/ips => generated 107 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 23 03:49:08 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi [req-2d27a2f0-8f1a-4f02-a9f0-dc32289fbd7d req-5010b466-dbdc-4e17-81c3-4c52a62a96e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "954f41b2-5c67-41a4-b38b-ebf3ad60cac7", "tag": "97d945a1-b86e-4a6d-af52-23084b8eb175"}]} {{(pid=61306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 03:49:08 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [req-2d27a2f0-8f1a-4f02-a9f0-dc32289fbd7d req-5010b466-dbdc-4e17-81c3-4c52a62a96e8 service nova] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:49:08 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [req-2d27a2f0-8f1a-4f02-a9f0-dc32289fbd7d req-5010b466-dbdc-4e17-81c3-4c52a62a96e8 service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:49:08 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [req-2d27a2f0-8f1a-4f02-a9f0-dc32289fbd7d req-5010b466-dbdc-4e17-81c3-4c52a62a96e8 service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:49:08 user devstack@n-api.service[61306]: INFO nova.api.openstack.compute.server_external_events [req-2d27a2f0-8f1a-4f02-a9f0-dc32289fbd7d req-5010b466-dbdc-4e17-81c3-4c52a62a96e8 service nova] Creating event network-changed:97d945a1-b86e-4a6d-af52-23084b8eb175 for instance 954f41b2-5c67-41a4-b38b-ebf3ad60cac7 on user Apr 23 03:49:08 user devstack@n-api.service[61306]: INFO nova.api.openstack.requestlog [req-2d27a2f0-8f1a-4f02-a9f0-dc32289fbd7d req-5010b466-dbdc-4e17-81c3-4c52a62a96e8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037399 Apr 23 03:49:08 user devstack@n-api.service[61306]: [pid: 61306|app: 0|req: 48/145] 10.0.0.210 () {68 vars in 1394 bytes} [Sun Apr 23 03:49:08 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 23 03:49:09 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi [None req-f84207f8-8f8e-48a8-a9f4-15f3e2b40a67 tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] Calling method '>' {{(pid=61307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 03:49:09 user devstack@n-api.service[61307]: DEBUG nova.compute.api [None req-f84207f8-8f8e-48a8-a9f4-15f3e2b40a67 tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] [instance: 954f41b2-5c67-41a4-b38b-ebf3ad60cac7] Fetching instance by UUID {{(pid=61307) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 23 03:49:09 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-f84207f8-8f8e-48a8-a9f4-15f3e2b40a67 tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:49:09 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-f84207f8-8f8e-48a8-a9f4-15f3e2b40a67 tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:49:09 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-f84207f8-8f8e-48a8-a9f4-15f3e2b40a67 tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:49:09 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-f84207f8-8f8e-48a8-a9f4-15f3e2b40a67 tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:49:09 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-f84207f8-8f8e-48a8-a9f4-15f3e2b40a67 tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:49:09 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-f84207f8-8f8e-48a8-a9f4-15f3e2b40a67 tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:49:09 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi [None req-a9ec8fdc-66e5-456a-93af-a260dbdbaabc tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-95239721", "imageRef": "e6127373-9931-4277-9458-eceef653ea1e", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "5604c946-dd68-4517-9c39-b4d33d86a345"}], "security_groups": [{"name": "tempest-securitygroup--631510518"}], "key_name": "tempest-keypair-1779422949", "user_data": "}} {{(pid=61308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 03:49:09 user devstack@n-api.service[61307]: DEBUG nova.policy [None req-f84207f8-8f8e-48a8-a9f4-15f3e2b40a67 tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdc8fe94058c46c28d4b3f16dc1e77ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f44fe9ba07e4e2f925d1a8952356e04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61307) authorize /opt/stack/nova/nova/policy.py:203}} Apr 23 03:49:09 user devstack@n-api.service[61307]: INFO nova.api.openstack.requestlog [None req-f84207f8-8f8e-48a8-a9f4-15f3e2b40a67 tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] 10.0.0.210 "GET /compute/v2.1/servers/954f41b2-5c67-41a4-b38b-ebf3ad60cac7" status: 200 len: 1539 microversion: 2.1 time: 0.762844 Apr 23 03:49:09 user devstack@n-api.service[61307]: [pid: 61307|app: 0|req: 48/146] 10.0.0.210 () {62 vars in 1313 bytes} [Sun Apr 23 03:49:08 2023] GET /compute/v2.1/servers/954f41b2-5c67-41a4-b38b-ebf3ad60cac7 => generated 1539 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 23 03:49:09 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi [None req-239f387f-5a0f-4933-8f71-e510fe417adb tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] Calling method '>' {{(pid=61306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 03:49:09 user devstack@n-api.service[61306]: DEBUG nova.compute.api [None req-239f387f-5a0f-4933-8f71-e510fe417adb tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] [instance: 954f41b2-5c67-41a4-b38b-ebf3ad60cac7] Fetching instance by UUID {{(pid=61306) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 23 03:49:09 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-239f387f-5a0f-4933-8f71-e510fe417adb tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:49:09 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-239f387f-5a0f-4933-8f71-e510fe417adb tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:49:09 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-239f387f-5a0f-4933-8f71-e510fe417adb tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:49:09 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-239f387f-5a0f-4933-8f71-e510fe417adb tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:49:09 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-239f387f-5a0f-4933-8f71-e510fe417adb tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:49:09 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-239f387f-5a0f-4933-8f71-e510fe417adb tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:49:09 user devstack@n-api.service[61308]: DEBUG nova.network.neutron [None req-a9ec8fdc-66e5-456a-93af-a260dbdbaabc tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] validate_networks() for [('5604c946-dd68-4517-9c39-b4d33d86a345', None, None, None, None, None)] {{(pid=61308) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 23 03:49:09 user devstack@n-api.service[61306]: DEBUG nova.policy [None req-239f387f-5a0f-4933-8f71-e510fe417adb tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdc8fe94058c46c28d4b3f16dc1e77ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f44fe9ba07e4e2f925d1a8952356e04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61306) authorize /opt/stack/nova/nova/policy.py:203}} Apr 23 03:49:09 user devstack@n-api.service[61306]: INFO nova.api.openstack.requestlog [None req-239f387f-5a0f-4933-8f71-e510fe417adb tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] 10.0.0.210 "GET /compute/v2.1/servers/954f41b2-5c67-41a4-b38b-ebf3ad60cac7" status: 200 len: 1658 microversion: 2.1 time: 0.159419 Apr 23 03:49:09 user devstack@n-api.service[61306]: [pid: 61306|app: 0|req: 49/147] 10.0.0.210 () {62 vars in 1313 bytes} [Sun Apr 23 03:49:09 2023] GET /compute/v2.1/servers/954f41b2-5c67-41a4-b38b-ebf3ad60cac7 => generated 1658 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 23 03:49:09 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi [None req-40a9e902-22c5-4b03-96e6-476673738e7f tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] Calling method '>' {{(pid=61307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 03:49:09 user devstack@n-api.service[61307]: DEBUG nova.compute.api [None req-40a9e902-22c5-4b03-96e6-476673738e7f tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] [instance: 954f41b2-5c67-41a4-b38b-ebf3ad60cac7] Fetching instance by UUID {{(pid=61307) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 23 03:49:09 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-40a9e902-22c5-4b03-96e6-476673738e7f tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:49:09 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-40a9e902-22c5-4b03-96e6-476673738e7f tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:49:09 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-40a9e902-22c5-4b03-96e6-476673738e7f tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:49:09 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-40a9e902-22c5-4b03-96e6-476673738e7f tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:49:09 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-40a9e902-22c5-4b03-96e6-476673738e7f tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:49:09 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-40a9e902-22c5-4b03-96e6-476673738e7f tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:49:10 user devstack@n-api.service[61307]: DEBUG nova.policy [None req-40a9e902-22c5-4b03-96e6-476673738e7f tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdc8fe94058c46c28d4b3f16dc1e77ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f44fe9ba07e4e2f925d1a8952356e04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61307) authorize /opt/stack/nova/nova/policy.py:203}} Apr 23 03:49:10 user devstack@n-api.service[61307]: INFO nova.api.openstack.requestlog [None req-40a9e902-22c5-4b03-96e6-476673738e7f tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] 10.0.0.210 "GET /compute/v2.1/servers/954f41b2-5c67-41a4-b38b-ebf3ad60cac7" status: 200 len: 1658 microversion: 2.1 time: 0.225181 Apr 23 03:49:10 user devstack@n-api.service[61307]: [pid: 61307|app: 0|req: 49/148] 10.0.0.210 () {62 vars in 1313 bytes} [Sun Apr 23 03:49:09 2023] GET /compute/v2.1/servers/954f41b2-5c67-41a4-b38b-ebf3ad60cac7 => generated 1658 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 23 03:49:10 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi [None req-aeac8a8c-69e5-4ef2-b812-1ef35e6691fe tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Calling method '>' {{(pid=61306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 03:49:10 user devstack@n-api.service[61306]: DEBUG nova.compute.api [None req-aeac8a8c-69e5-4ef2-b812-1ef35e6691fe tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] [instance: 3ec36a95-88ce-4ed1-9726-7e6d98674dec] Fetching instance by UUID {{(pid=61306) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 23 03:49:10 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-aeac8a8c-69e5-4ef2-b812-1ef35e6691fe tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:49:10 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-aeac8a8c-69e5-4ef2-b812-1ef35e6691fe tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:49:10 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-aeac8a8c-69e5-4ef2-b812-1ef35e6691fe tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:49:10 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-aeac8a8c-69e5-4ef2-b812-1ef35e6691fe tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:49:10 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-aeac8a8c-69e5-4ef2-b812-1ef35e6691fe tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:49:10 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-aeac8a8c-69e5-4ef2-b812-1ef35e6691fe tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:49:10 user devstack@n-api.service[61306]: DEBUG nova.compute.api [None req-aeac8a8c-69e5-4ef2-b812-1ef35e6691fe tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] [instance: 3ec36a95-88ce-4ed1-9726-7e6d98674dec] Going to try to terminate instance {{(pid=61306) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 23 03:49:10 user devstack@n-api.service[61308]: DEBUG nova.virt.hardware [None req-a9ec8fdc-66e5-456a-93af-a260dbdbaabc tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] Flavor limits 0:0:0 {{(pid=61308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 23 03:49:10 user devstack@n-api.service[61308]: DEBUG nova.virt.hardware [None req-a9ec8fdc-66e5-456a-93af-a260dbdbaabc tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] Image limits 0:0:0 {{(pid=61308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 23 03:49:10 user devstack@n-api.service[61308]: DEBUG nova.virt.hardware [None req-a9ec8fdc-66e5-456a-93af-a260dbdbaabc tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] Flavor pref 0:0:0 {{(pid=61308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 23 03:49:10 user devstack@n-api.service[61308]: DEBUG nova.virt.hardware [None req-a9ec8fdc-66e5-456a-93af-a260dbdbaabc tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] Image pref 0:0:0 {{(pid=61308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 23 03:49:10 user devstack@n-api.service[61308]: DEBUG nova.virt.hardware [None req-a9ec8fdc-66e5-456a-93af-a260dbdbaabc tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 23 03:49:10 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-a9ec8fdc-66e5-456a-93af-a260dbdbaabc tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:49:10 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-a9ec8fdc-66e5-456a-93af-a260dbdbaabc tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:49:10 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-a9ec8fdc-66e5-456a-93af-a260dbdbaabc tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:49:10 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-a9ec8fdc-66e5-456a-93af-a260dbdbaabc tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:49:10 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-a9ec8fdc-66e5-456a-93af-a260dbdbaabc tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:49:10 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-a9ec8fdc-66e5-456a-93af-a260dbdbaabc tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:49:10 user devstack@n-api.service[61306]: INFO nova.api.openstack.requestlog [None req-aeac8a8c-69e5-4ef2-b812-1ef35e6691fe tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/3ec36a95-88ce-4ed1-9726-7e6d98674dec" status: 204 len: 0 microversion: 2.1 time: 0.184997 Apr 23 03:49:10 user devstack@n-api.service[61306]: [pid: 61306|app: 0|req: 50/149] 10.0.0.210 () {62 vars in 1316 bytes} [Sun Apr 23 03:49:10 2023] DELETE /compute/v2.1/servers/3ec36a95-88ce-4ed1-9726-7e6d98674dec => generated 0 bytes in 186 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 23 03:49:10 user devstack@n-api.service[61308]: DEBUG nova.quota [None req-a9ec8fdc-66e5-456a-93af-a260dbdbaabc tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] Getting quotas for project 70b031ddc5c94ca98e7161de03bda4b7. Resources: {'ram', 'instances', 'cores'} {{(pid=61308) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 23 03:49:10 user devstack@n-api.service[61308]: DEBUG nova.quota [None req-a9ec8fdc-66e5-456a-93af-a260dbdbaabc tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] Getting quotas for user e3d689f1c160478ca83bbff3104d8ec3 and project 70b031ddc5c94ca98e7161de03bda4b7. Resources: {'ram', 'instances', 'cores'} {{(pid=61308) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 23 03:49:10 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi [None req-dae4945e-9bb3-4d3e-9f13-8a051768b663 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Calling method '>' {{(pid=61307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 03:49:10 user devstack@n-api.service[61307]: DEBUG nova.compute.api [None req-dae4945e-9bb3-4d3e-9f13-8a051768b663 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] [instance: 3ec36a95-88ce-4ed1-9726-7e6d98674dec] Fetching instance by UUID {{(pid=61307) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 23 03:49:10 user devstack@n-api.service[61308]: DEBUG nova.compute.api [None req-a9ec8fdc-66e5-456a-93af-a260dbdbaabc tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] Going to run 1 instances... {{(pid=61308) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 23 03:49:10 user devstack@n-api.service[61308]: DEBUG nova.compute.api [None req-a9ec8fdc-66e5-456a-93af-a260dbdbaabc tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] [instance: 6ee9a44e-e6af-4eec-975c-3991146ce71b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e6127373-9931-4277-9458-eceef653ea1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61308) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 23 03:49:10 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-dae4945e-9bb3-4d3e-9f13-8a051768b663 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:49:10 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-dae4945e-9bb3-4d3e-9f13-8a051768b663 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:49:10 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-dae4945e-9bb3-4d3e-9f13-8a051768b663 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:49:10 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-dae4945e-9bb3-4d3e-9f13-8a051768b663 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:49:10 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-dae4945e-9bb3-4d3e-9f13-8a051768b663 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:49:10 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-dae4945e-9bb3-4d3e-9f13-8a051768b663 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:49:10 user devstack@n-api.service[61308]: INFO nova.api.openstack.requestlog [None req-a9ec8fdc-66e5-456a-93af-a260dbdbaabc tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 0.803556 Apr 23 03:49:10 user devstack@n-api.service[61308]: [pid: 61308|app: 0|req: 51/150] 10.0.0.210 () {64 vars in 1224 bytes} [Sun Apr 23 03:49:09 2023] POST /compute/v2.1/servers => generated 399 bytes in 806 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 23 03:49:10 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi [None req-cde64071-82ce-43d1-a2d0-8511a83e0aea tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] Calling method '>' {{(pid=61306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 03:49:10 user devstack@n-api.service[61306]: DEBUG nova.compute.api [None req-cde64071-82ce-43d1-a2d0-8511a83e0aea tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] [instance: 6ee9a44e-e6af-4eec-975c-3991146ce71b] Fetching instance by UUID {{(pid=61306) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 23 03:49:10 user devstack@n-api.service[61306]: DEBUG nova.policy [None req-cde64071-82ce-43d1-a2d0-8511a83e0aea tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d689f1c160478ca83bbff3104d8ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b031ddc5c94ca98e7161de03bda4b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61306) authorize /opt/stack/nova/nova/policy.py:203}} Apr 23 03:49:10 user devstack@n-api.service[61306]: INFO nova.api.openstack.requestlog [None req-cde64071-82ce-43d1-a2d0-8511a83e0aea tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6ee9a44e-e6af-4eec-975c-3991146ce71b" status: 200 len: 1230 microversion: 2.1 time: 0.088642 Apr 23 03:49:10 user devstack@n-api.service[61306]: [pid: 61306|app: 0|req: 51/151] 10.0.0.210 () {62 vars in 1313 bytes} [Sun Apr 23 03:49:10 2023] GET /compute/v2.1/servers/6ee9a44e-e6af-4eec-975c-3991146ce71b => generated 1230 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 23 03:49:10 user devstack@n-api.service[61307]: DEBUG nova.policy [None req-dae4945e-9bb3-4d3e-9f13-8a051768b663 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2c459cad014b07b2613e5e261d88aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24fff486a500421397ecb935828582cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61307) authorize /opt/stack/nova/nova/policy.py:203}} Apr 23 03:49:10 user devstack@n-api.service[61307]: INFO nova.api.openstack.requestlog [None req-dae4945e-9bb3-4d3e-9f13-8a051768b663 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3ec36a95-88ce-4ed1-9726-7e6d98674dec" status: 200 len: 1666 microversion: 2.1 time: 0.353599 Apr 23 03:49:10 user devstack@n-api.service[61307]: [pid: 61307|app: 0|req: 50/152] 10.0.0.210 () {62 vars in 1313 bytes} [Sun Apr 23 03:49:10 2023] GET /compute/v2.1/servers/3ec36a95-88ce-4ed1-9726-7e6d98674dec => generated 1666 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 23 03:49:10 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi [req-6ebb98de-8a20-413b-bad4-e4b3e74b2e16 req-8fb37789-5018-4c0f-bc7a-eaa7a90013e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ec36a95-88ce-4ed1-9726-7e6d98674dec", "name": "network-vif-unplugged", "status": "completed", "tag": "af57258e-69b3-405b-a9f6-8d54c1810960"}]} {{(pid=61308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 03:49:10 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [req-6ebb98de-8a20-413b-bad4-e4b3e74b2e16 req-8fb37789-5018-4c0f-bc7a-eaa7a90013e1 service nova] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:49:10 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [req-6ebb98de-8a20-413b-bad4-e4b3e74b2e16 req-8fb37789-5018-4c0f-bc7a-eaa7a90013e1 service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:49:10 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [req-6ebb98de-8a20-413b-bad4-e4b3e74b2e16 req-8fb37789-5018-4c0f-bc7a-eaa7a90013e1 service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:49:10 user devstack@n-api.service[61308]: INFO nova.api.openstack.compute.server_external_events [req-6ebb98de-8a20-413b-bad4-e4b3e74b2e16 req-8fb37789-5018-4c0f-bc7a-eaa7a90013e1 service nova] Creating event network-vif-unplugged:af57258e-69b3-405b-a9f6-8d54c1810960 for instance 3ec36a95-88ce-4ed1-9726-7e6d98674dec on user Apr 23 03:49:10 user devstack@n-api.service[61308]: INFO nova.api.openstack.requestlog [req-6ebb98de-8a20-413b-bad4-e4b3e74b2e16 req-8fb37789-5018-4c0f-bc7a-eaa7a90013e1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.027743 Apr 23 03:49:10 user devstack@n-api.service[61308]: [pid: 61308|app: 0|req: 52/153] 10.0.0.210 () {68 vars in 1394 bytes} [Sun Apr 23 03:49:10 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 23 03:49:10 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi [req-81a5e1e3-e308-45fe-94d9-c503ffecc66a req-e0781568-8388-4342-aab8-73a56bfa669f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8480a7c-b5de-4f66-a4f0-08fc679b0dfd", "tag": "e7548d21-c865-4648-a8a6-dba748a01e14"}]} {{(pid=61306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 03:49:11 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [req-81a5e1e3-e308-45fe-94d9-c503ffecc66a req-e0781568-8388-4342-aab8-73a56bfa669f service nova] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:49:11 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [req-81a5e1e3-e308-45fe-94d9-c503ffecc66a req-e0781568-8388-4342-aab8-73a56bfa669f service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:49:11 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [req-81a5e1e3-e308-45fe-94d9-c503ffecc66a req-e0781568-8388-4342-aab8-73a56bfa669f service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:49:11 user devstack@n-api.service[61306]: INFO nova.api.openstack.compute.server_external_events [req-81a5e1e3-e308-45fe-94d9-c503ffecc66a req-e0781568-8388-4342-aab8-73a56bfa669f service nova] Creating event network-changed:e7548d21-c865-4648-a8a6-dba748a01e14 for instance c8480a7c-b5de-4f66-a4f0-08fc679b0dfd on user Apr 23 03:49:11 user devstack@n-api.service[61306]: INFO nova.api.openstack.requestlog [req-81a5e1e3-e308-45fe-94d9-c503ffecc66a req-e0781568-8388-4342-aab8-73a56bfa669f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043734 Apr 23 03:49:11 user devstack@n-api.service[61306]: [pid: 61306|app: 0|req: 52/154] 10.0.0.210 () {68 vars in 1394 bytes} [Sun Apr 23 03:49:10 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 23 03:49:12 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi [req-73be63ee-aba6-46cb-8df3-7e567912a91e req-1604a95c-da6a-4f40-aa49-974b22c85e19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ec36a95-88ce-4ed1-9726-7e6d98674dec", "name": "network-vif-plugged", "status": "completed", "tag": "af57258e-69b3-405b-a9f6-8d54c1810960"}, {"server_uuid": "3ec36a95-88ce-4ed1-9726-7e6d98674dec", "name": "network-vif-deleted", "tag": "af57258e-69b3-405b-a9f6-8d54c1810960"}]} {{(pid=61307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 03:49:12 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [req-73be63ee-aba6-46cb-8df3-7e567912a91e req-1604a95c-da6a-4f40-aa49-974b22c85e19 service nova] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:49:12 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [req-73be63ee-aba6-46cb-8df3-7e567912a91e req-1604a95c-da6a-4f40-aa49-974b22c85e19 service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:49:12 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [req-73be63ee-aba6-46cb-8df3-7e567912a91e req-1604a95c-da6a-4f40-aa49-974b22c85e19 service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:49:12 user devstack@n-api.service[61307]: INFO nova.api.openstack.compute.server_external_events [req-73be63ee-aba6-46cb-8df3-7e567912a91e req-1604a95c-da6a-4f40-aa49-974b22c85e19 service nova] Creating event network-vif-plugged:af57258e-69b3-405b-a9f6-8d54c1810960 for instance 3ec36a95-88ce-4ed1-9726-7e6d98674dec on user Apr 23 03:49:12 user devstack@n-api.service[61307]: INFO nova.api.openstack.compute.server_external_events [req-73be63ee-aba6-46cb-8df3-7e567912a91e req-1604a95c-da6a-4f40-aa49-974b22c85e19 service nova] Creating event network-vif-deleted:af57258e-69b3-405b-a9f6-8d54c1810960 for instance 3ec36a95-88ce-4ed1-9726-7e6d98674dec on user Apr 23 03:49:12 user devstack@n-api.service[61307]: INFO nova.api.openstack.requestlog [req-73be63ee-aba6-46cb-8df3-7e567912a91e req-1604a95c-da6a-4f40-aa49-974b22c85e19 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.030708 Apr 23 03:49:12 user devstack@n-api.service[61307]: [pid: 61307|app: 0|req: 51/155] 10.0.0.210 () {68 vars in 1394 bytes} [Sun Apr 23 03:49:12 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 23 03:49:12 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi [req-6179646f-122a-4fa6-8c11-51f6c9b3f606 req-de762340-a5f0-4c0f-b2dd-08b10db113d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8480a7c-b5de-4f66-a4f0-08fc679b0dfd", "name": "network-vif-plugged", "status": "completed", "tag": "e7548d21-c865-4648-a8a6-dba748a01e14"}]} {{(pid=61308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 03:49:12 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [req-6179646f-122a-4fa6-8c11-51f6c9b3f606 req-de762340-a5f0-4c0f-b2dd-08b10db113d0 service nova] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:49:12 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [req-6179646f-122a-4fa6-8c11-51f6c9b3f606 req-de762340-a5f0-4c0f-b2dd-08b10db113d0 service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:49:12 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [req-6179646f-122a-4fa6-8c11-51f6c9b3f606 req-de762340-a5f0-4c0f-b2dd-08b10db113d0 service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:49:12 user devstack@n-api.service[61308]: INFO nova.api.openstack.compute.server_external_events [req-6179646f-122a-4fa6-8c11-51f6c9b3f606 req-de762340-a5f0-4c0f-b2dd-08b10db113d0 service nova] Creating event network-vif-plugged:e7548d21-c865-4648-a8a6-dba748a01e14 for instance c8480a7c-b5de-4f66-a4f0-08fc679b0dfd on user Apr 23 03:49:12 user devstack@n-api.service[61308]: INFO nova.api.openstack.requestlog [req-6179646f-122a-4fa6-8c11-51f6c9b3f606 req-de762340-a5f0-4c0f-b2dd-08b10db113d0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040957 Apr 23 03:49:12 user devstack@n-api.service[61308]: [pid: 61308|app: 0|req: 53/156] 10.0.0.210 () {68 vars in 1394 bytes} [Sun Apr 23 03:49:12 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 23 03:49:14 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi [req-00c4a25c-660a-4eea-8a7e-b727a37a999c req-5d8f24d6-ab8e-4f71-954b-38c093b89979 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8480a7c-b5de-4f66-a4f0-08fc679b0dfd", "name": "network-vif-plugged", "status": "completed", "tag": "e7548d21-c865-4648-a8a6-dba748a01e14"}]} {{(pid=61306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 03:49:14 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [req-00c4a25c-660a-4eea-8a7e-b727a37a999c req-5d8f24d6-ab8e-4f71-954b-38c093b89979 service nova] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:49:14 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [req-00c4a25c-660a-4eea-8a7e-b727a37a999c req-5d8f24d6-ab8e-4f71-954b-38c093b89979 service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:49:14 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [req-00c4a25c-660a-4eea-8a7e-b727a37a999c req-5d8f24d6-ab8e-4f71-954b-38c093b89979 service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:49:14 user devstack@n-api.service[61306]: INFO nova.api.openstack.compute.server_external_events [req-00c4a25c-660a-4eea-8a7e-b727a37a999c req-5d8f24d6-ab8e-4f71-954b-38c093b89979 service nova] Creating event network-vif-plugged:e7548d21-c865-4648-a8a6-dba748a01e14 for instance c8480a7c-b5de-4f66-a4f0-08fc679b0dfd on user Apr 23 03:49:15 user devstack@n-api.service[61306]: INFO nova.api.openstack.requestlog [req-00c4a25c-660a-4eea-8a7e-b727a37a999c req-5d8f24d6-ab8e-4f71-954b-38c093b89979 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033568 Apr 23 03:49:15 user devstack@n-api.service[61306]: [pid: 61306|app: 0|req: 53/157] 10.0.0.210 () {68 vars in 1394 bytes} [Sun Apr 23 03:49:14 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 23 03:49:15 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi [None req-71f1f7f9-aed7-44c7-a07c-98490cd8b9c9 tempest-VolumesAdminNegativeTest-594073230 tempest-VolumesAdminNegativeTest-594073230-project-member] Calling method '>' {{(pid=61307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 03:49:15 user devstack@n-api.service[61307]: DEBUG nova.compute.api [None req-71f1f7f9-aed7-44c7-a07c-98490cd8b9c9 tempest-VolumesAdminNegativeTest-594073230 tempest-VolumesAdminNegativeTest-594073230-project-member] [instance: 91756f90-733e-4aa5-9108-d2d8b1d020fe] Fetching instance by UUID {{(pid=61307) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 23 03:49:15 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-71f1f7f9-aed7-44c7-a07c-98490cd8b9c9 tempest-VolumesAdminNegativeTest-594073230 tempest-VolumesAdminNegativeTest-594073230-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:49:15 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-71f1f7f9-aed7-44c7-a07c-98490cd8b9c9 tempest-VolumesAdminNegativeTest-594073230 tempest-VolumesAdminNegativeTest-594073230-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:49:15 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-71f1f7f9-aed7-44c7-a07c-98490cd8b9c9 tempest-VolumesAdminNegativeTest-594073230 tempest-VolumesAdminNegativeTest-594073230-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:49:15 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-71f1f7f9-aed7-44c7-a07c-98490cd8b9c9 tempest-VolumesAdminNegativeTest-594073230 tempest-VolumesAdminNegativeTest-594073230-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:49:15 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-71f1f7f9-aed7-44c7-a07c-98490cd8b9c9 tempest-VolumesAdminNegativeTest-594073230 tempest-VolumesAdminNegativeTest-594073230-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:49:15 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-71f1f7f9-aed7-44c7-a07c-98490cd8b9c9 tempest-VolumesAdminNegativeTest-594073230 tempest-VolumesAdminNegativeTest-594073230-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:49:15 user devstack@n-api.service[61307]: INFO nova.api.openstack.requestlog [None req-71f1f7f9-aed7-44c7-a07c-98490cd8b9c9 tempest-VolumesAdminNegativeTest-594073230 tempest-VolumesAdminNegativeTest-594073230-project-member] 10.0.0.210 "GET /compute/v2.1/servers/91756f90-733e-4aa5-9108-d2d8b1d020fe/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.167154 Apr 23 03:49:15 user devstack@n-api.service[61307]: [pid: 61307|app: 0|req: 52/158] 10.0.0.210 () {62 vars in 1352 bytes} [Sun Apr 23 03:49:15 2023] GET /compute/v2.1/servers/91756f90-733e-4aa5-9108-d2d8b1d020fe/os-interface => generated 282 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 23 03:49:15 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi [req-c00d7f3c-ff71-4e5d-9399-67fc69730a7a req-cf9e0e51-233f-4a04-baf5-370e7a5c7a02 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ee9a44e-e6af-4eec-975c-3991146ce71b", "tag": "aaf8a702-e47a-4fc7-a9a8-3a7e63525294"}]} {{(pid=61308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 03:49:15 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [req-c00d7f3c-ff71-4e5d-9399-67fc69730a7a req-cf9e0e51-233f-4a04-baf5-370e7a5c7a02 service nova] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:49:15 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [req-c00d7f3c-ff71-4e5d-9399-67fc69730a7a req-cf9e0e51-233f-4a04-baf5-370e7a5c7a02 service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:49:15 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [req-c00d7f3c-ff71-4e5d-9399-67fc69730a7a req-cf9e0e51-233f-4a04-baf5-370e7a5c7a02 service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:49:15 user devstack@n-api.service[61308]: INFO nova.api.openstack.compute.server_external_events [req-c00d7f3c-ff71-4e5d-9399-67fc69730a7a req-cf9e0e51-233f-4a04-baf5-370e7a5c7a02 service nova] Creating event network-changed:aaf8a702-e47a-4fc7-a9a8-3a7e63525294 for instance 6ee9a44e-e6af-4eec-975c-3991146ce71b on user Apr 23 03:49:15 user devstack@n-api.service[61308]: INFO nova.api.openstack.requestlog [req-c00d7f3c-ff71-4e5d-9399-67fc69730a7a req-cf9e0e51-233f-4a04-baf5-370e7a5c7a02 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075242 Apr 23 03:49:15 user devstack@n-api.service[61308]: [pid: 61308|app: 0|req: 54/159] 10.0.0.210 () {68 vars in 1394 bytes} [Sun Apr 23 03:49:15 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 23 03:49:16 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi [req-e05a44f1-4539-4faf-9ab2-a9a4909a88cf req-119f6ee8-a686-4993-9712-7cda50f1318f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91756f90-733e-4aa5-9108-d2d8b1d020fe", "tag": "b7f45c1f-8b9b-4d06-a389-d7643565e934"}]} {{(pid=61306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 03:49:16 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [req-e05a44f1-4539-4faf-9ab2-a9a4909a88cf req-119f6ee8-a686-4993-9712-7cda50f1318f service nova] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:49:16 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [req-e05a44f1-4539-4faf-9ab2-a9a4909a88cf req-119f6ee8-a686-4993-9712-7cda50f1318f service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:49:16 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [req-e05a44f1-4539-4faf-9ab2-a9a4909a88cf req-119f6ee8-a686-4993-9712-7cda50f1318f service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:49:16 user devstack@n-api.service[61306]: INFO nova.api.openstack.compute.server_external_events [req-e05a44f1-4539-4faf-9ab2-a9a4909a88cf req-119f6ee8-a686-4993-9712-7cda50f1318f service nova] Creating event network-changed:b7f45c1f-8b9b-4d06-a389-d7643565e934 for instance 91756f90-733e-4aa5-9108-d2d8b1d020fe on user Apr 23 03:49:16 user devstack@n-api.service[61306]: INFO nova.api.openstack.requestlog [req-e05a44f1-4539-4faf-9ab2-a9a4909a88cf req-119f6ee8-a686-4993-9712-7cda50f1318f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048506 Apr 23 03:49:16 user devstack@n-api.service[61306]: [pid: 61306|app: 0|req: 54/160] 10.0.0.210 () {68 vars in 1394 bytes} [Sun Apr 23 03:49:16 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 23 03:49:17 user devstack@n-api.service[61307]: DEBUG dbcounter [-] [61307] Writing DB stats nova_cell0:SELECT=2 {{(pid=61307) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:49:17 user devstack@n-api.service[61307]: DEBUG dbcounter [-] [61307] Writing DB stats nova_cell0:SELECT=6 {{(pid=61307) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:49:17 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi [req-07b54934-0dd6-4ee3-b058-c8e3abf17809 req-a6c6f08e-d163-4ccb-b9c5-22ef6e907bcb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ee9a44e-e6af-4eec-975c-3991146ce71b", "name": "network-vif-plugged", "status": "completed", "tag": "aaf8a702-e47a-4fc7-a9a8-3a7e63525294"}]} {{(pid=61307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 03:49:17 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [req-07b54934-0dd6-4ee3-b058-c8e3abf17809 req-a6c6f08e-d163-4ccb-b9c5-22ef6e907bcb service nova] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:49:17 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [req-07b54934-0dd6-4ee3-b058-c8e3abf17809 req-a6c6f08e-d163-4ccb-b9c5-22ef6e907bcb service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:49:17 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [req-07b54934-0dd6-4ee3-b058-c8e3abf17809 req-a6c6f08e-d163-4ccb-b9c5-22ef6e907bcb service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:49:17 user devstack@n-api.service[61307]: INFO nova.api.openstack.compute.server_external_events [req-07b54934-0dd6-4ee3-b058-c8e3abf17809 req-a6c6f08e-d163-4ccb-b9c5-22ef6e907bcb service nova] Creating event network-vif-plugged:aaf8a702-e47a-4fc7-a9a8-3a7e63525294 for instance 6ee9a44e-e6af-4eec-975c-3991146ce71b on user Apr 23 03:49:17 user devstack@n-api.service[61307]: INFO nova.api.openstack.requestlog [req-07b54934-0dd6-4ee3-b058-c8e3abf17809 req-a6c6f08e-d163-4ccb-b9c5-22ef6e907bcb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056603 Apr 23 03:49:17 user devstack@n-api.service[61307]: [pid: 61307|app: 0|req: 53/161] 10.0.0.210 () {68 vars in 1394 bytes} [Sun Apr 23 03:49:17 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 23 03:49:18 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi [None req-2f5331cf-5248-4779-ace7-796a35f344aa tempest-VolumesAdminNegativeTest-594073230 tempest-VolumesAdminNegativeTest-594073230-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1265143385", "imageRef": "e6127373-9931-4277-9458-eceef653ea1e", "flavorRef": "42", "networks": [{"uuid": "dca689d5-53e5-466b-bd5c-4c29b330d27e"}]}} {{(pid=61308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 03:49:18 user devstack@n-api.service[61308]: DEBUG nova.network.neutron [None req-2f5331cf-5248-4779-ace7-796a35f344aa tempest-VolumesAdminNegativeTest-594073230 tempest-VolumesAdminNegativeTest-594073230-project-member] validate_networks() for [('dca689d5-53e5-466b-bd5c-4c29b330d27e', None, None, None, None, None)] {{(pid=61308) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 23 03:49:18 user devstack@n-api.service[61308]: DEBUG nova.virt.hardware [None req-2f5331cf-5248-4779-ace7-796a35f344aa tempest-VolumesAdminNegativeTest-594073230 tempest-VolumesAdminNegativeTest-594073230-project-member] Flavor limits 0:0:0 {{(pid=61308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 23 03:49:18 user devstack@n-api.service[61308]: DEBUG nova.virt.hardware [None req-2f5331cf-5248-4779-ace7-796a35f344aa tempest-VolumesAdminNegativeTest-594073230 tempest-VolumesAdminNegativeTest-594073230-project-member] Image limits 0:0:0 {{(pid=61308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 23 03:49:18 user devstack@n-api.service[61308]: DEBUG nova.virt.hardware [None req-2f5331cf-5248-4779-ace7-796a35f344aa tempest-VolumesAdminNegativeTest-594073230 tempest-VolumesAdminNegativeTest-594073230-project-member] Flavor pref 0:0:0 {{(pid=61308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 23 03:49:18 user devstack@n-api.service[61308]: DEBUG nova.virt.hardware [None req-2f5331cf-5248-4779-ace7-796a35f344aa tempest-VolumesAdminNegativeTest-594073230 tempest-VolumesAdminNegativeTest-594073230-project-member] Image pref 0:0:0 {{(pid=61308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 23 03:49:18 user devstack@n-api.service[61308]: DEBUG nova.virt.hardware [None req-2f5331cf-5248-4779-ace7-796a35f344aa tempest-VolumesAdminNegativeTest-594073230 tempest-VolumesAdminNegativeTest-594073230-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 23 03:49:18 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-2f5331cf-5248-4779-ace7-796a35f344aa tempest-VolumesAdminNegativeTest-594073230 tempest-VolumesAdminNegativeTest-594073230-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:49:18 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-2f5331cf-5248-4779-ace7-796a35f344aa tempest-VolumesAdminNegativeTest-594073230 tempest-VolumesAdminNegativeTest-594073230-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:49:18 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-2f5331cf-5248-4779-ace7-796a35f344aa tempest-VolumesAdminNegativeTest-594073230 tempest-VolumesAdminNegativeTest-594073230-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:49:18 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-2f5331cf-5248-4779-ace7-796a35f344aa tempest-VolumesAdminNegativeTest-594073230 tempest-VolumesAdminNegativeTest-594073230-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:49:18 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-2f5331cf-5248-4779-ace7-796a35f344aa tempest-VolumesAdminNegativeTest-594073230 tempest-VolumesAdminNegativeTest-594073230-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:49:18 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-2f5331cf-5248-4779-ace7-796a35f344aa tempest-VolumesAdminNegativeTest-594073230 tempest-VolumesAdminNegativeTest-594073230-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:49:18 user devstack@n-api.service[61308]: DEBUG nova.quota [None req-2f5331cf-5248-4779-ace7-796a35f344aa tempest-VolumesAdminNegativeTest-594073230 tempest-VolumesAdminNegativeTest-594073230-project-member] Getting quotas for project 5eb0a03655cf4aa78e27c81ea4e1c424. Resources: {'ram', 'instances', 'cores'} {{(pid=61308) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 23 03:49:18 user devstack@n-api.service[61308]: DEBUG nova.quota [None req-2f5331cf-5248-4779-ace7-796a35f344aa tempest-VolumesAdminNegativeTest-594073230 tempest-VolumesAdminNegativeTest-594073230-project-member] Getting quotas for user 3e80c354abd34bd3a28ddaeec9535af2 and project 5eb0a03655cf4aa78e27c81ea4e1c424. Resources: {'ram', 'instances', 'cores'} {{(pid=61308) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 23 03:49:18 user devstack@n-api.service[61308]: DEBUG nova.compute.api [None req-2f5331cf-5248-4779-ace7-796a35f344aa tempest-VolumesAdminNegativeTest-594073230 tempest-VolumesAdminNegativeTest-594073230-project-member] Going to run 1 instances... {{(pid=61308) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 23 03:49:18 user devstack@n-api.service[61308]: DEBUG nova.compute.api [None req-2f5331cf-5248-4779-ace7-796a35f344aa tempest-VolumesAdminNegativeTest-594073230 tempest-VolumesAdminNegativeTest-594073230-project-member] [instance: 1d5ec75f-29f2-45c3-8d6e-74d9ec8b2f86] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e6127373-9931-4277-9458-eceef653ea1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61308) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 23 03:49:18 user devstack@n-api.service[61308]: INFO nova.api.openstack.requestlog [None req-2f5331cf-5248-4779-ace7-796a35f344aa tempest-VolumesAdminNegativeTest-594073230 tempest-VolumesAdminNegativeTest-594073230-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.563213 Apr 23 03:49:18 user devstack@n-api.service[61308]: [pid: 61308|app: 0|req: 55/162] 10.0.0.210 () {64 vars in 1224 bytes} [Sun Apr 23 03:49:18 2023] POST /compute/v2.1/servers => generated 378 bytes in 566 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 23 03:49:18 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi [None req-672e4519-e077-4e4a-b17d-7d4873d3d761 tempest-VolumesAdminNegativeTest-594073230 tempest-VolumesAdminNegativeTest-594073230-project-member] Calling method '>' {{(pid=61306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 03:49:18 user devstack@n-api.service[61306]: DEBUG nova.compute.api [None req-672e4519-e077-4e4a-b17d-7d4873d3d761 tempest-VolumesAdminNegativeTest-594073230 tempest-VolumesAdminNegativeTest-594073230-project-member] [instance: 1d5ec75f-29f2-45c3-8d6e-74d9ec8b2f86] Fetching instance by UUID {{(pid=61306) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 23 03:49:18 user devstack@n-api.service[61306]: DEBUG nova.policy [None req-672e4519-e077-4e4a-b17d-7d4873d3d761 tempest-VolumesAdminNegativeTest-594073230 tempest-VolumesAdminNegativeTest-594073230-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e80c354abd34bd3a28ddaeec9535af2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb0a03655cf4aa78e27c81ea4e1c424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61306) authorize /opt/stack/nova/nova/policy.py:203}} Apr 23 03:49:18 user devstack@n-api.service[61306]: INFO nova.api.openstack.requestlog [None req-672e4519-e077-4e4a-b17d-7d4873d3d761 tempest-VolumesAdminNegativeTest-594073230 tempest-VolumesAdminNegativeTest-594073230-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1d5ec75f-29f2-45c3-8d6e-74d9ec8b2f86" status: 200 len: 1212 microversion: 2.1 time: 0.065883 Apr 23 03:49:18 user devstack@n-api.service[61306]: [pid: 61306|app: 0|req: 55/163] 10.0.0.210 () {62 vars in 1313 bytes} [Sun Apr 23 03:49:18 2023] GET /compute/v2.1/servers/1d5ec75f-29f2-45c3-8d6e-74d9ec8b2f86 => generated 1212 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 23 03:49:19 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi [req-b1a48472-64e2-4797-a21c-7d2caca25d19 req-39be0c9c-3e5e-414b-9c35-af8526dab406 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ee9a44e-e6af-4eec-975c-3991146ce71b", "name": "network-vif-plugged", "status": "completed", "tag": "aaf8a702-e47a-4fc7-a9a8-3a7e63525294"}]} {{(pid=61307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 03:49:19 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [req-b1a48472-64e2-4797-a21c-7d2caca25d19 req-39be0c9c-3e5e-414b-9c35-af8526dab406 service nova] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:49:19 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [req-b1a48472-64e2-4797-a21c-7d2caca25d19 req-39be0c9c-3e5e-414b-9c35-af8526dab406 service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:49:19 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [req-b1a48472-64e2-4797-a21c-7d2caca25d19 req-39be0c9c-3e5e-414b-9c35-af8526dab406 service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:49:19 user devstack@n-api.service[61307]: INFO nova.api.openstack.compute.server_external_events [req-b1a48472-64e2-4797-a21c-7d2caca25d19 req-39be0c9c-3e5e-414b-9c35-af8526dab406 service nova] Creating event network-vif-plugged:aaf8a702-e47a-4fc7-a9a8-3a7e63525294 for instance 6ee9a44e-e6af-4eec-975c-3991146ce71b on user Apr 23 03:49:19 user devstack@n-api.service[61307]: INFO nova.api.openstack.requestlog [req-b1a48472-64e2-4797-a21c-7d2caca25d19 req-39be0c9c-3e5e-414b-9c35-af8526dab406 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031449 Apr 23 03:49:19 user devstack@n-api.service[61307]: [pid: 61307|app: 0|req: 54/164] 10.0.0.210 () {68 vars in 1394 bytes} [Sun Apr 23 03:49:19 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 23 03:49:21 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi [req-d143aafe-e574-412a-9742-2cdea5b03e06 req-90f3c6c4-3518-4bde-b747-84388988f901 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d5ec75f-29f2-45c3-8d6e-74d9ec8b2f86", "tag": "dbcb6234-6b80-49f9-b7a1-0f339da7084a"}]} {{(pid=61308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 03:49:21 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [req-d143aafe-e574-412a-9742-2cdea5b03e06 req-90f3c6c4-3518-4bde-b747-84388988f901 service nova] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:49:21 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [req-d143aafe-e574-412a-9742-2cdea5b03e06 req-90f3c6c4-3518-4bde-b747-84388988f901 service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:49:21 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [req-d143aafe-e574-412a-9742-2cdea5b03e06 req-90f3c6c4-3518-4bde-b747-84388988f901 service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:49:21 user devstack@n-api.service[61308]: INFO nova.api.openstack.compute.server_external_events [req-d143aafe-e574-412a-9742-2cdea5b03e06 req-90f3c6c4-3518-4bde-b747-84388988f901 service nova] Creating event network-changed:dbcb6234-6b80-49f9-b7a1-0f339da7084a for instance 1d5ec75f-29f2-45c3-8d6e-74d9ec8b2f86 on user Apr 23 03:49:21 user devstack@n-api.service[61308]: INFO nova.api.openstack.requestlog [req-d143aafe-e574-412a-9742-2cdea5b03e06 req-90f3c6c4-3518-4bde-b747-84388988f901 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033862 Apr 23 03:49:21 user devstack@n-api.service[61308]: [pid: 61308|app: 0|req: 56/165] 10.0.0.210 () {68 vars in 1394 bytes} [Sun Apr 23 03:49:21 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 23 03:49:23 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi [req-67402369-f10d-4fac-9196-932baf15100c req-c04c8b77-dbe0-460e-b159-4a249283318a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d5ec75f-29f2-45c3-8d6e-74d9ec8b2f86", "name": "network-vif-plugged", "status": "completed", "tag": "dbcb6234-6b80-49f9-b7a1-0f339da7084a"}]} {{(pid=61306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 03:49:23 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [req-67402369-f10d-4fac-9196-932baf15100c req-c04c8b77-dbe0-460e-b159-4a249283318a service nova] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:49:23 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [req-67402369-f10d-4fac-9196-932baf15100c req-c04c8b77-dbe0-460e-b159-4a249283318a service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:49:23 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [req-67402369-f10d-4fac-9196-932baf15100c req-c04c8b77-dbe0-460e-b159-4a249283318a service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:49:23 user devstack@n-api.service[61306]: INFO nova.api.openstack.compute.server_external_events [req-67402369-f10d-4fac-9196-932baf15100c req-c04c8b77-dbe0-460e-b159-4a249283318a service nova] Creating event network-vif-plugged:dbcb6234-6b80-49f9-b7a1-0f339da7084a for instance 1d5ec75f-29f2-45c3-8d6e-74d9ec8b2f86 on user Apr 23 03:49:23 user devstack@n-api.service[61306]: INFO nova.api.openstack.requestlog [req-67402369-f10d-4fac-9196-932baf15100c req-c04c8b77-dbe0-460e-b159-4a249283318a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045888 Apr 23 03:49:23 user devstack@n-api.service[61306]: [pid: 61306|app: 0|req: 56/166] 10.0.0.210 () {68 vars in 1394 bytes} [Sun Apr 23 03:49:23 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 23 03:49:25 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi [None req-1015ef8a-674b-4b15-88b0-b061df97f45a tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] Calling method '>' {{(pid=61307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 03:49:25 user devstack@n-api.service[61307]: DEBUG nova.compute.api [None req-1015ef8a-674b-4b15-88b0-b061df97f45a tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] [instance: 6f7cf091-3140-4746-bd1c-95c42ea82f6e] Fetching instance by UUID {{(pid=61307) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 23 03:49:25 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-1015ef8a-674b-4b15-88b0-b061df97f45a tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:49:25 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-1015ef8a-674b-4b15-88b0-b061df97f45a tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:49:25 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-1015ef8a-674b-4b15-88b0-b061df97f45a tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:49:25 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-1015ef8a-674b-4b15-88b0-b061df97f45a tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:49:25 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-1015ef8a-674b-4b15-88b0-b061df97f45a tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:49:25 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-1015ef8a-674b-4b15-88b0-b061df97f45a tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:49:25 user devstack@n-api.service[61307]: DEBUG nova.policy [None req-1015ef8a-674b-4b15-88b0-b061df97f45a tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93a8dbfd8cef4578aff742813ffe901e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab0f01751954d04a83b360b2f839716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61307) authorize /opt/stack/nova/nova/policy.py:203}} Apr 23 03:49:25 user devstack@n-api.service[61307]: INFO nova.api.openstack.requestlog [None req-1015ef8a-674b-4b15-88b0-b061df97f45a tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6f7cf091-3140-4746-bd1c-95c42ea82f6e" status: 200 len: 1537 microversion: 2.1 time: 0.228151 Apr 23 03:49:25 user devstack@n-api.service[61307]: [pid: 61307|app: 0|req: 55/167] 10.0.0.210 () {62 vars in 1313 bytes} [Sun Apr 23 03:49:25 2023] GET /compute/v2.1/servers/6f7cf091-3140-4746-bd1c-95c42ea82f6e => generated 1537 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 23 03:49:25 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi [None req-b6d8fec2-e699-41d5-92c3-0717c8b13d1c tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] Calling method '>' {{(pid=61308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 03:49:25 user devstack@n-api.service[61308]: DEBUG nova.policy [None req-b6d8fec2-e699-41d5-92c3-0717c8b13d1c tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '93a8dbfd8cef4578aff742813ffe901e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab0f01751954d04a83b360b2f839716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61308) authorize /opt/stack/nova/nova/policy.py:203}} Apr 23 03:49:25 user devstack@n-api.service[61308]: DEBUG nova.compute.api [None req-b6d8fec2-e699-41d5-92c3-0717c8b13d1c tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] Searching by: {'deleted': False, 'project_id': '8ab0f01751954d04a83b360b2f839716'} {{(pid=61308) get_all /opt/stack/nova/nova/compute/api.py:3019}} Apr 23 03:49:25 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-b6d8fec2-e699-41d5-92c3-0717c8b13d1c tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:49:25 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-b6d8fec2-e699-41d5-92c3-0717c8b13d1c tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:49:25 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-b6d8fec2-e699-41d5-92c3-0717c8b13d1c tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:49:25 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-b6d8fec2-e699-41d5-92c3-0717c8b13d1c tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:49:25 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-b6d8fec2-e699-41d5-92c3-0717c8b13d1c tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:49:25 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-b6d8fec2-e699-41d5-92c3-0717c8b13d1c tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:49:25 user devstack@n-api.service[61308]: DEBUG nova.compute.multi_cell_list [None req-b6d8fec2-e699-41d5-92c3-0717c8b13d1c tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=61308) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 23 03:49:25 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi [req-05201324-95b0-4cb2-ab33-fd603a36c1f9 req-7b47a4a1-ce37-42aa-bc67-d55d37b81742 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d5ec75f-29f2-45c3-8d6e-74d9ec8b2f86", "name": "network-vif-plugged", "status": "completed", "tag": "dbcb6234-6b80-49f9-b7a1-0f339da7084a"}]} {{(pid=61306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 03:49:25 user devstack@n-api.service[61308]: INFO nova.api.openstack.requestlog [None req-b6d8fec2-e699-41d5-92c3-0717c8b13d1c tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] 10.0.0.210 "GET /compute/v2.1/servers" status: 200 len: 340 microversion: 2.1 time: 0.210808 Apr 23 03:49:25 user devstack@n-api.service[61308]: [pid: 61308|app: 0|req: 57/168] 10.0.0.210 () {62 vars in 1202 bytes} [Sun Apr 23 03:49:25 2023] GET /compute/v2.1/servers => generated 340 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 23 03:49:25 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [req-05201324-95b0-4cb2-ab33-fd603a36c1f9 req-7b47a4a1-ce37-42aa-bc67-d55d37b81742 service nova] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:49:25 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [req-05201324-95b0-4cb2-ab33-fd603a36c1f9 req-7b47a4a1-ce37-42aa-bc67-d55d37b81742 service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:49:25 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [req-05201324-95b0-4cb2-ab33-fd603a36c1f9 req-7b47a4a1-ce37-42aa-bc67-d55d37b81742 service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:49:25 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi [None req-2b351e6e-7ad2-4689-ab88-a2ef1c9f969d tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] Calling method '>' {{(pid=61307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 03:49:25 user devstack@n-api.service[61307]: DEBUG nova.compute.api [None req-2b351e6e-7ad2-4689-ab88-a2ef1c9f969d tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] [instance: 6f7cf091-3140-4746-bd1c-95c42ea82f6e] Fetching instance by UUID {{(pid=61307) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 23 03:49:25 user devstack@n-api.service[61306]: INFO nova.api.openstack.compute.server_external_events [req-05201324-95b0-4cb2-ab33-fd603a36c1f9 req-7b47a4a1-ce37-42aa-bc67-d55d37b81742 service nova] Creating event network-vif-plugged:dbcb6234-6b80-49f9-b7a1-0f339da7084a for instance 1d5ec75f-29f2-45c3-8d6e-74d9ec8b2f86 on user Apr 23 03:49:25 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-2b351e6e-7ad2-4689-ab88-a2ef1c9f969d tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:49:25 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-2b351e6e-7ad2-4689-ab88-a2ef1c9f969d tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:49:25 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-2b351e6e-7ad2-4689-ab88-a2ef1c9f969d tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:49:25 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-2b351e6e-7ad2-4689-ab88-a2ef1c9f969d tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:49:25 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-2b351e6e-7ad2-4689-ab88-a2ef1c9f969d tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:49:25 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-2b351e6e-7ad2-4689-ab88-a2ef1c9f969d tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:49:25 user devstack@n-api.service[61306]: INFO nova.api.openstack.requestlog [req-05201324-95b0-4cb2-ab33-fd603a36c1f9 req-7b47a4a1-ce37-42aa-bc67-d55d37b81742 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053558 Apr 23 03:49:25 user devstack@n-api.service[61306]: [pid: 61306|app: 0|req: 57/169] 10.0.0.210 () {68 vars in 1394 bytes} [Sun Apr 23 03:49:25 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 23 03:49:25 user devstack@n-api.service[61307]: DEBUG nova.policy [None req-2b351e6e-7ad2-4689-ab88-a2ef1c9f969d tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93a8dbfd8cef4578aff742813ffe901e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab0f01751954d04a83b360b2f839716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61307) authorize /opt/stack/nova/nova/policy.py:203}} Apr 23 03:49:25 user devstack@n-api.service[61307]: INFO nova.api.openstack.requestlog [None req-2b351e6e-7ad2-4689-ab88-a2ef1c9f969d tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6f7cf091-3140-4746-bd1c-95c42ea82f6e" status: 200 len: 1537 microversion: 2.1 time: 0.172902 Apr 23 03:49:25 user devstack@n-api.service[61307]: [pid: 61307|app: 0|req: 56/170] 10.0.0.210 () {62 vars in 1313 bytes} [Sun Apr 23 03:49:25 2023] GET /compute/v2.1/servers/6f7cf091-3140-4746-bd1c-95c42ea82f6e => generated 1537 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 23 03:49:27 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi [None req-40fb21b4-cbee-43b6-ba73-5319bf398107 tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] Calling method '>' {{(pid=61308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 03:49:27 user devstack@n-api.service[61308]: DEBUG nova.compute.api [None req-40fb21b4-cbee-43b6-ba73-5319bf398107 tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] [instance: 6f7cf091-3140-4746-bd1c-95c42ea82f6e] Fetching instance by UUID {{(pid=61308) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 23 03:49:27 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-40fb21b4-cbee-43b6-ba73-5319bf398107 tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:49:27 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-40fb21b4-cbee-43b6-ba73-5319bf398107 tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:49:27 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-40fb21b4-cbee-43b6-ba73-5319bf398107 tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:49:27 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-40fb21b4-cbee-43b6-ba73-5319bf398107 tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:49:27 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-40fb21b4-cbee-43b6-ba73-5319bf398107 tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:49:27 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-40fb21b4-cbee-43b6-ba73-5319bf398107 tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:49:27 user devstack@n-api.service[61308]: DEBUG nova.compute.api [None req-40fb21b4-cbee-43b6-ba73-5319bf398107 tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] [instance: 6f7cf091-3140-4746-bd1c-95c42ea82f6e] Going to try to terminate instance {{(pid=61308) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 23 03:49:27 user devstack@n-api.service[61308]: INFO nova.api.openstack.requestlog [None req-40fb21b4-cbee-43b6-ba73-5319bf398107 tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/6f7cf091-3140-4746-bd1c-95c42ea82f6e" status: 204 len: 0 microversion: 2.1 time: 0.113599 Apr 23 03:49:27 user devstack@n-api.service[61308]: [pid: 61308|app: 0|req: 58/171] 10.0.0.210 () {62 vars in 1316 bytes} [Sun Apr 23 03:49:27 2023] DELETE /compute/v2.1/servers/6f7cf091-3140-4746-bd1c-95c42ea82f6e => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 23 03:49:27 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi [None req-79e8fbd3-e71f-47ee-b100-a2d6d65d123f tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] Calling method '>' {{(pid=61306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 03:49:27 user devstack@n-api.service[61306]: DEBUG nova.compute.api [None req-79e8fbd3-e71f-47ee-b100-a2d6d65d123f tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] [instance: 6f7cf091-3140-4746-bd1c-95c42ea82f6e] Fetching instance by UUID {{(pid=61306) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 23 03:49:27 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-79e8fbd3-e71f-47ee-b100-a2d6d65d123f tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:49:27 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-79e8fbd3-e71f-47ee-b100-a2d6d65d123f tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:49:27 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-79e8fbd3-e71f-47ee-b100-a2d6d65d123f tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:49:27 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-79e8fbd3-e71f-47ee-b100-a2d6d65d123f tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:49:27 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-79e8fbd3-e71f-47ee-b100-a2d6d65d123f tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:49:27 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-79e8fbd3-e71f-47ee-b100-a2d6d65d123f tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:49:28 user devstack@n-api.service[61306]: DEBUG nova.policy [None req-79e8fbd3-e71f-47ee-b100-a2d6d65d123f tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93a8dbfd8cef4578aff742813ffe901e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab0f01751954d04a83b360b2f839716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61306) authorize /opt/stack/nova/nova/policy.py:203}} Apr 23 03:49:28 user devstack@n-api.service[61306]: INFO nova.api.openstack.requestlog [None req-79e8fbd3-e71f-47ee-b100-a2d6d65d123f tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6f7cf091-3140-4746-bd1c-95c42ea82f6e" status: 200 len: 1543 microversion: 2.1 time: 0.345084 Apr 23 03:49:28 user devstack@n-api.service[61306]: [pid: 61306|app: 0|req: 58/172] 10.0.0.210 () {62 vars in 1313 bytes} [Sun Apr 23 03:49:27 2023] GET /compute/v2.1/servers/6f7cf091-3140-4746-bd1c-95c42ea82f6e => generated 1543 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 23 03:49:28 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi [req-91767a31-cfec-442e-8b64-d7349de291e9 req-79652b74-fcca-4c8e-abcb-407336ce2c0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f7cf091-3140-4746-bd1c-95c42ea82f6e", "name": "network-vif-unplugged", "status": "completed", "tag": "fcf25b83-715e-4e6e-a7a3-d7f94072883f"}]} {{(pid=61307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 03:49:28 user devstack@n-api.service[61307]: DEBUG dbcounter [-] [61307] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=3 {{(pid=61307) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:49:28 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [req-91767a31-cfec-442e-8b64-d7349de291e9 req-79652b74-fcca-4c8e-abcb-407336ce2c0a service nova] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:49:28 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [req-91767a31-cfec-442e-8b64-d7349de291e9 req-79652b74-fcca-4c8e-abcb-407336ce2c0a service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:49:28 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [req-91767a31-cfec-442e-8b64-d7349de291e9 req-79652b74-fcca-4c8e-abcb-407336ce2c0a service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:49:28 user devstack@n-api.service[61307]: DEBUG dbcounter [-] [61307] Writing DB stats nova_cell1:SELECT=53 {{(pid=61307) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:49:28 user devstack@n-api.service[61307]: INFO nova.api.openstack.compute.server_external_events [req-91767a31-cfec-442e-8b64-d7349de291e9 req-79652b74-fcca-4c8e-abcb-407336ce2c0a service nova] Creating event network-vif-unplugged:fcf25b83-715e-4e6e-a7a3-d7f94072883f for instance 6f7cf091-3140-4746-bd1c-95c42ea82f6e on user Apr 23 03:49:28 user devstack@n-api.service[61307]: INFO nova.api.openstack.requestlog [req-91767a31-cfec-442e-8b64-d7349de291e9 req-79652b74-fcca-4c8e-abcb-407336ce2c0a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038813 Apr 23 03:49:28 user devstack@n-api.service[61307]: [pid: 61307|app: 0|req: 57/173] 10.0.0.210 () {68 vars in 1394 bytes} [Sun Apr 23 03:49:28 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 23 03:49:30 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi [req-f928d779-3828-4e76-ae57-599dddd3d46f req-5858d58e-31b8-4ea3-b0b9-cca91e655a6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f7cf091-3140-4746-bd1c-95c42ea82f6e", "name": "network-vif-plugged", "status": "completed", "tag": "fcf25b83-715e-4e6e-a7a3-d7f94072883f"}, {"server_uuid": "6f7cf091-3140-4746-bd1c-95c42ea82f6e", "name": "network-vif-deleted", "tag": "fcf25b83-715e-4e6e-a7a3-d7f94072883f"}]} {{(pid=61308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 03:49:30 user devstack@n-api.service[61308]: DEBUG dbcounter [-] [61308] Writing DB stats nova_cell0:SELECT=18 {{(pid=61308) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:49:30 user devstack@n-api.service[61308]: DEBUG dbcounter [-] [61308] Writing DB stats nova_api:SELECT=68,nova_api:DELETE=1,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=61308) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:49:30 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [req-f928d779-3828-4e76-ae57-599dddd3d46f req-5858d58e-31b8-4ea3-b0b9-cca91e655a6e service nova] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:49:30 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [req-f928d779-3828-4e76-ae57-599dddd3d46f req-5858d58e-31b8-4ea3-b0b9-cca91e655a6e service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:49:30 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [req-f928d779-3828-4e76-ae57-599dddd3d46f req-5858d58e-31b8-4ea3-b0b9-cca91e655a6e service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:49:30 user devstack@n-api.service[61308]: INFO nova.api.openstack.compute.server_external_events [req-f928d779-3828-4e76-ae57-599dddd3d46f req-5858d58e-31b8-4ea3-b0b9-cca91e655a6e service nova] Creating event network-vif-plugged:fcf25b83-715e-4e6e-a7a3-d7f94072883f for instance 6f7cf091-3140-4746-bd1c-95c42ea82f6e on user Apr 23 03:49:30 user devstack@n-api.service[61308]: INFO nova.api.openstack.compute.server_external_events [req-f928d779-3828-4e76-ae57-599dddd3d46f req-5858d58e-31b8-4ea3-b0b9-cca91e655a6e service nova] Creating event network-vif-deleted:fcf25b83-715e-4e6e-a7a3-d7f94072883f for instance 6f7cf091-3140-4746-bd1c-95c42ea82f6e on user Apr 23 03:49:30 user devstack@n-api.service[61308]: INFO nova.api.openstack.requestlog [req-f928d779-3828-4e76-ae57-599dddd3d46f req-5858d58e-31b8-4ea3-b0b9-cca91e655a6e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.035166 Apr 23 03:49:30 user devstack@n-api.service[61308]: [pid: 61308|app: 0|req: 59/174] 10.0.0.210 () {68 vars in 1394 bytes} [Sun Apr 23 03:49:30 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 23 03:49:34 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi [None req-6f445f78-9221-49e1-b5d4-6c23a6dd2355 tempest-AttachSCSIVolumeTestJSON-1319344340 tempest-AttachSCSIVolumeTestJSON-1319344340-project-member] Calling method '>' {{(pid=61306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 03:49:34 user devstack@n-api.service[61306]: DEBUG nova.compute.api [None req-6f445f78-9221-49e1-b5d4-6c23a6dd2355 tempest-AttachSCSIVolumeTestJSON-1319344340 tempest-AttachSCSIVolumeTestJSON-1319344340-project-member] [instance: ba71c9bf-4d96-4fdc-8a55-cbdc75c29e72] Fetching instance by UUID {{(pid=61306) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 23 03:49:34 user devstack@n-api.service[61306]: DEBUG dbcounter [-] [61306] Writing DB stats nova_cell0:SELECT=4 {{(pid=61306) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:49:34 user devstack@n-api.service[61306]: DEBUG dbcounter [-] [61306] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1 {{(pid=61306) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:49:34 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-6f445f78-9221-49e1-b5d4-6c23a6dd2355 tempest-AttachSCSIVolumeTestJSON-1319344340 tempest-AttachSCSIVolumeTestJSON-1319344340-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:49:34 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-6f445f78-9221-49e1-b5d4-6c23a6dd2355 tempest-AttachSCSIVolumeTestJSON-1319344340 tempest-AttachSCSIVolumeTestJSON-1319344340-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:49:34 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-6f445f78-9221-49e1-b5d4-6c23a6dd2355 tempest-AttachSCSIVolumeTestJSON-1319344340 tempest-AttachSCSIVolumeTestJSON-1319344340-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:49:34 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-6f445f78-9221-49e1-b5d4-6c23a6dd2355 tempest-AttachSCSIVolumeTestJSON-1319344340 tempest-AttachSCSIVolumeTestJSON-1319344340-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:49:34 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-6f445f78-9221-49e1-b5d4-6c23a6dd2355 tempest-AttachSCSIVolumeTestJSON-1319344340 tempest-AttachSCSIVolumeTestJSON-1319344340-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:49:34 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-6f445f78-9221-49e1-b5d4-6c23a6dd2355 tempest-AttachSCSIVolumeTestJSON-1319344340 tempest-AttachSCSIVolumeTestJSON-1319344340-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:49:34 user devstack@n-api.service[61306]: DEBUG dbcounter [-] [61306] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61306) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:49:34 user devstack@n-api.service[61306]: INFO nova.api.openstack.wsgi [None req-6f445f78-9221-49e1-b5d4-6c23a6dd2355 tempest-AttachSCSIVolumeTestJSON-1319344340 tempest-AttachSCSIVolumeTestJSON-1319344340-project-member] HTTP exception thrown: Instance ba71c9bf-4d96-4fdc-8a55-cbdc75c29e72 could not be found. Apr 23 03:49:34 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi [None req-6f445f78-9221-49e1-b5d4-6c23a6dd2355 tempest-AttachSCSIVolumeTestJSON-1319344340 tempest-AttachSCSIVolumeTestJSON-1319344340-project-member] Request method failure captured: Apr 23 03:49:34 user devstack@n-api.service[61306]: request: GET /compute/v2.1/servers/ba71c9bf-4d96-4fdc-8a55-cbdc75c29e72 HTTP/1.1 Apr 23 03:49:34 user devstack@n-api.service[61306]: Accept: application/json Apr 23 03:49:34 user devstack@n-api.service[61306]: Accept-Encoding: identity Apr 23 03:49:34 user devstack@n-api.service[61306]: Connection: close Apr 23 03:49:34 user devstack@n-api.service[61306]: Content-Length: 0 Apr 23 03:49:34 user devstack@n-api.service[61306]: Content-Type: application/json Apr 23 03:49:34 user devstack@n-api.service[61306]: Host: 10.0.0.210 Apr 23 03:49:34 user devstack@n-api.service[61306]: Openstack-System-Scope: None Apr 23 03:49:34 user devstack@n-api.service[61306]: User-Agent: python-urllib3/1.26.15 Apr 23 03:49:34 user devstack@n-api.service[61306]: X-Auth-Token: gAAAAABkRKoNUoGxZ78vaaoxGOyAiDv0tiF8umVzHyD6H7rLrTS4LimOqwwELI8sh5v660FCVJiH7gaHDbRhra40jli9VGAtXUI9mUjPhcHWCUAo-HMnz7pw1L4O1mKJnbWKPVjW-hJZQnSqkPp2gsMNvqeUacDDP1gMW7tZekYKQBgOLdChWj8 Apr 23 03:49:34 user devstack@n-api.service[61306]: X-Domain-Id: None Apr 23 03:49:34 user devstack@n-api.service[61306]: X-Domain-Name: None Apr 23 03:49:34 user devstack@n-api.service[61306]: X-Identity-Status: Confirmed Apr 23 03:49:34 user devstack@n-api.service[61306]: X-Is-Admin-Project: True Apr 23 03:49:34 user devstack@n-api.service[61306]: X-Project-Domain-Id: default Apr 23 03:49:34 user devstack@n-api.service[61306]: X-Project-Domain-Name: Default Apr 23 03:49:34 user devstack@n-api.service[61306]: X-Project-Id: 0f253a2e878a45d99dd3cbda86c0c6ff Apr 23 03:49:34 user devstack@n-api.service[61306]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1319344340 Apr 23 03:49:34 user devstack@n-api.service[61306]: X-Role: reader,member Apr 23 03:49:34 user devstack@n-api.service[61306]: X-Roles: reader,member Apr 23 03:49:34 user devstack@n-api.service[61306]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0f253a2e878a45d99dd3cbda86c0c6ff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0f253a2e878a45d99dd3cbda86c0c6ff"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0f253a2e878a45d99dd3cbda86c0c6ff"}]}] Apr 23 03:49:34 user devstack@n-api.service[61306]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1319344340 Apr 23 03:49:34 user devstack@n-api.service[61306]: X-Tenant-Id: 0f253a2e878a45d99dd3cbda86c0c6ff Apr 23 03:49:34 user devstack@n-api.service[61306]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1319344340 Apr 23 03:49:34 user devstack@n-api.service[61306]: X-User: tempest-AttachSCSIVolumeTestJSON-1319344340-project-member Apr 23 03:49:34 user devstack@n-api.service[61306]: X-User-Domain-Id: default Apr 23 03:49:34 user devstack@n-api.service[61306]: X-User-Domain-Name: Default Apr 23 03:49:34 user devstack@n-api.service[61306]: X-User-Id: fc51570d0e7c4617ac6b8fa428b9660f Apr 23 03:49:34 user devstack@n-api.service[61306]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1319344340-project-member Apr 23 03:49:34 user devstack@n-api.service[61306]: method: > Apr 23 03:49:34 user devstack@n-api.service[61306]: exception: Instance ba71c9bf-4d96-4fdc-8a55-cbdc75c29e72 could not be found. Apr 23 03:49:34 user devstack@n-api.service[61306]: action_args: {'id': 'ba71c9bf-4d96-4fdc-8a55-cbdc75c29e72'} Apr 23 03:49:34 user devstack@n-api.service[61306]: {{(pid=61306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 23 03:49:34 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 23 03:49:34 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 23 03:49:34 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 23 03:49:34 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 23 03:49:34 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 23 03:49:34 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 23 03:49:34 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 23 03:49:34 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 23 03:49:34 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 23 03:49:34 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba71c9bf-4d96-4fdc-8a55-cbdc75c29e72 could not be found. Apr 23 03:49:34 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi Apr 23 03:49:34 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 23 03:49:34 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi Apr 23 03:49:34 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 23 03:49:34 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 23 03:49:34 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 23 03:49:34 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 23 03:49:34 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 23 03:49:34 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 23 03:49:34 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 23 03:49:34 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 23 03:49:35 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 23 03:49:35 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 23 03:49:35 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 23 03:49:35 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 23 03:49:35 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 23 03:49:35 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba71c9bf-4d96-4fdc-8a55-cbdc75c29e72 could not be found. Apr 23 03:49:35 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi Apr 23 03:49:35 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 23 03:49:35 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi Apr 23 03:49:35 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 23 03:49:35 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 23 03:49:35 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 23 03:49:35 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 23 03:49:35 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 23 03:49:35 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba71c9bf-4d96-4fdc-8a55-cbdc75c29e72 could not be found. Apr 23 03:49:35 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi Apr 23 03:49:35 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi [None req-6f445f78-9221-49e1-b5d4-6c23a6dd2355 tempest-AttachSCSIVolumeTestJSON-1319344340 tempest-AttachSCSIVolumeTestJSON-1319344340-project-member] Returning 404 to user: Instance ba71c9bf-4d96-4fdc-8a55-cbdc75c29e72 could not be found. {{(pid=61306) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 23 03:49:35 user devstack@n-api.service[61306]: INFO nova.api.openstack.requestlog [None req-6f445f78-9221-49e1-b5d4-6c23a6dd2355 tempest-AttachSCSIVolumeTestJSON-1319344340 tempest-AttachSCSIVolumeTestJSON-1319344340-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ba71c9bf-4d96-4fdc-8a55-cbdc75c29e72" status: 404 len: 111 microversion: 2.1 time: 0.050421 Apr 23 03:49:35 user devstack@n-api.service[61306]: [pid: 61306|app: 0|req: 59/175] 10.0.0.210 () {62 vars in 1313 bytes} [Sun Apr 23 03:49:34 2023] GET /compute/v2.1/servers/ba71c9bf-4d96-4fdc-8a55-cbdc75c29e72 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 23 03:49:35 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi [None req-11cba477-8bad-4a68-9160-488ea3821efa tempest-AttachSCSIVolumeTestJSON-1319344340 tempest-AttachSCSIVolumeTestJSON-1319344340-project-member] Calling method '.version_select at 0x7f21e1202dd0>' {{(pid=61307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 03:49:35 user devstack@n-api.service[61307]: INFO nova.api.openstack.requestlog [None req-11cba477-8bad-4a68-9160-488ea3821efa tempest-AttachSCSIVolumeTestJSON-1319344340 tempest-AttachSCSIVolumeTestJSON-1319344340-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-282378258" status: 202 len: 0 microversion: 2.1 time: 0.072141 Apr 23 03:49:35 user devstack@n-api.service[61307]: [pid: 61307|app: 0|req: 58/176] 10.0.0.210 () {62 vars in 1295 bytes} [Sun Apr 23 03:49:35 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-282378258 => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 23 03:49:36 user devstack@n-api.service[61308]: DEBUG dbcounter [-] [61308] Writing DB stats nova_cell0:SELECT=6 {{(pid=61308) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:49:36 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi [None req-5f840201-cc72-4e11-9ac2-65833e1a7b51 tempest-AttachSCSIVolumeTestJSON-1319344340 tempest-AttachSCSIVolumeTestJSON-1319344340-project-member] Calling method '>' {{(pid=61308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 03:49:36 user devstack@n-api.service[61308]: DEBUG nova.compute.api [None req-5f840201-cc72-4e11-9ac2-65833e1a7b51 tempest-AttachSCSIVolumeTestJSON-1319344340 tempest-AttachSCSIVolumeTestJSON-1319344340-project-member] [instance: ba71c9bf-4d96-4fdc-8a55-cbdc75c29e72] Fetching instance by UUID {{(pid=61308) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 23 03:49:36 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-5f840201-cc72-4e11-9ac2-65833e1a7b51 tempest-AttachSCSIVolumeTestJSON-1319344340 tempest-AttachSCSIVolumeTestJSON-1319344340-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:49:36 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-5f840201-cc72-4e11-9ac2-65833e1a7b51 tempest-AttachSCSIVolumeTestJSON-1319344340 tempest-AttachSCSIVolumeTestJSON-1319344340-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:49:36 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-5f840201-cc72-4e11-9ac2-65833e1a7b51 tempest-AttachSCSIVolumeTestJSON-1319344340 tempest-AttachSCSIVolumeTestJSON-1319344340-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:49:36 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-5f840201-cc72-4e11-9ac2-65833e1a7b51 tempest-AttachSCSIVolumeTestJSON-1319344340 tempest-AttachSCSIVolumeTestJSON-1319344340-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:49:36 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-5f840201-cc72-4e11-9ac2-65833e1a7b51 tempest-AttachSCSIVolumeTestJSON-1319344340 tempest-AttachSCSIVolumeTestJSON-1319344340-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:49:36 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-5f840201-cc72-4e11-9ac2-65833e1a7b51 tempest-AttachSCSIVolumeTestJSON-1319344340 tempest-AttachSCSIVolumeTestJSON-1319344340-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:49:36 user devstack@n-api.service[61308]: INFO nova.api.openstack.wsgi [None req-5f840201-cc72-4e11-9ac2-65833e1a7b51 tempest-AttachSCSIVolumeTestJSON-1319344340 tempest-AttachSCSIVolumeTestJSON-1319344340-project-member] HTTP exception thrown: Instance ba71c9bf-4d96-4fdc-8a55-cbdc75c29e72 could not be found. Apr 23 03:49:36 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi [None req-5f840201-cc72-4e11-9ac2-65833e1a7b51 tempest-AttachSCSIVolumeTestJSON-1319344340 tempest-AttachSCSIVolumeTestJSON-1319344340-project-member] Request method failure captured: Apr 23 03:49:36 user devstack@n-api.service[61308]: request: DELETE /compute/v2.1/servers/ba71c9bf-4d96-4fdc-8a55-cbdc75c29e72 HTTP/1.1 Apr 23 03:49:36 user devstack@n-api.service[61308]: Accept: application/json Apr 23 03:49:36 user devstack@n-api.service[61308]: Accept-Encoding: identity Apr 23 03:49:36 user devstack@n-api.service[61308]: Connection: close Apr 23 03:49:36 user devstack@n-api.service[61308]: Content-Length: 0 Apr 23 03:49:36 user devstack@n-api.service[61308]: Content-Type: application/json Apr 23 03:49:36 user devstack@n-api.service[61308]: Host: 10.0.0.210 Apr 23 03:49:36 user devstack@n-api.service[61308]: Openstack-System-Scope: None Apr 23 03:49:36 user devstack@n-api.service[61308]: User-Agent: python-urllib3/1.26.15 Apr 23 03:49:36 user devstack@n-api.service[61308]: X-Auth-Token: gAAAAABkRKoNUoGxZ78vaaoxGOyAiDv0tiF8umVzHyD6H7rLrTS4LimOqwwELI8sh5v660FCVJiH7gaHDbRhra40jli9VGAtXUI9mUjPhcHWCUAo-HMnz7pw1L4O1mKJnbWKPVjW-hJZQnSqkPp2gsMNvqeUacDDP1gMW7tZekYKQBgOLdChWj8 Apr 23 03:49:36 user devstack@n-api.service[61308]: X-Domain-Id: None Apr 23 03:49:36 user devstack@n-api.service[61308]: X-Domain-Name: None Apr 23 03:49:36 user devstack@n-api.service[61308]: X-Identity-Status: Confirmed Apr 23 03:49:36 user devstack@n-api.service[61308]: X-Is-Admin-Project: True Apr 23 03:49:36 user devstack@n-api.service[61308]: X-Project-Domain-Id: default Apr 23 03:49:36 user devstack@n-api.service[61308]: X-Project-Domain-Name: Default Apr 23 03:49:36 user devstack@n-api.service[61308]: X-Project-Id: 0f253a2e878a45d99dd3cbda86c0c6ff Apr 23 03:49:36 user devstack@n-api.service[61308]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1319344340 Apr 23 03:49:36 user devstack@n-api.service[61308]: X-Role: reader,member Apr 23 03:49:36 user devstack@n-api.service[61308]: X-Roles: reader,member Apr 23 03:49:36 user devstack@n-api.service[61308]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0f253a2e878a45d99dd3cbda86c0c6ff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0f253a2e878a45d99dd3cbda86c0c6ff"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0f253a2e878a45d99dd3cbda86c0c6ff"}]}] Apr 23 03:49:36 user devstack@n-api.service[61308]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1319344340 Apr 23 03:49:36 user devstack@n-api.service[61308]: X-Tenant-Id: 0f253a2e878a45d99dd3cbda86c0c6ff Apr 23 03:49:36 user devstack@n-api.service[61308]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1319344340 Apr 23 03:49:36 user devstack@n-api.service[61308]: X-User: tempest-AttachSCSIVolumeTestJSON-1319344340-project-member Apr 23 03:49:36 user devstack@n-api.service[61308]: X-User-Domain-Id: default Apr 23 03:49:36 user devstack@n-api.service[61308]: X-User-Domain-Name: Default Apr 23 03:49:36 user devstack@n-api.service[61308]: X-User-Id: fc51570d0e7c4617ac6b8fa428b9660f Apr 23 03:49:36 user devstack@n-api.service[61308]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1319344340-project-member Apr 23 03:49:36 user devstack@n-api.service[61308]: method: > Apr 23 03:49:36 user devstack@n-api.service[61308]: exception: Instance ba71c9bf-4d96-4fdc-8a55-cbdc75c29e72 could not be found. Apr 23 03:49:36 user devstack@n-api.service[61308]: action_args: {'id': 'ba71c9bf-4d96-4fdc-8a55-cbdc75c29e72'} Apr 23 03:49:36 user devstack@n-api.service[61308]: {{(pid=61308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 23 03:49:36 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 23 03:49:36 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 23 03:49:36 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 23 03:49:36 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 23 03:49:36 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 23 03:49:36 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 23 03:49:36 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 23 03:49:36 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 23 03:49:36 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 23 03:49:36 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba71c9bf-4d96-4fdc-8a55-cbdc75c29e72 could not be found. Apr 23 03:49:36 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi Apr 23 03:49:36 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 23 03:49:36 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi Apr 23 03:49:36 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 23 03:49:36 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 23 03:49:36 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 23 03:49:36 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 23 03:49:36 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 23 03:49:36 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 23 03:49:36 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 23 03:49:36 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 23 03:49:36 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 23 03:49:36 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 23 03:49:36 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 23 03:49:36 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 23 03:49:36 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 23 03:49:36 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 23 03:49:36 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 23 03:49:36 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba71c9bf-4d96-4fdc-8a55-cbdc75c29e72 could not be found. Apr 23 03:49:36 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi Apr 23 03:49:36 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 23 03:49:36 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi Apr 23 03:49:36 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 23 03:49:36 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 23 03:49:36 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 23 03:49:36 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 23 03:49:36 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 23 03:49:36 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba71c9bf-4d96-4fdc-8a55-cbdc75c29e72 could not be found. Apr 23 03:49:36 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi Apr 23 03:49:36 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi [None req-5f840201-cc72-4e11-9ac2-65833e1a7b51 tempest-AttachSCSIVolumeTestJSON-1319344340 tempest-AttachSCSIVolumeTestJSON-1319344340-project-member] Returning 404 to user: Instance ba71c9bf-4d96-4fdc-8a55-cbdc75c29e72 could not be found. {{(pid=61308) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 23 03:49:36 user devstack@n-api.service[61308]: INFO nova.api.openstack.requestlog [None req-5f840201-cc72-4e11-9ac2-65833e1a7b51 tempest-AttachSCSIVolumeTestJSON-1319344340 tempest-AttachSCSIVolumeTestJSON-1319344340-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/ba71c9bf-4d96-4fdc-8a55-cbdc75c29e72" status: 404 len: 111 microversion: 2.1 time: 0.043448 Apr 23 03:49:36 user devstack@n-api.service[61308]: [pid: 61308|app: 0|req: 60/177] 10.0.0.210 () {62 vars in 1316 bytes} [Sun Apr 23 03:49:36 2023] DELETE /compute/v2.1/servers/ba71c9bf-4d96-4fdc-8a55-cbdc75c29e72 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 23 03:49:36 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi [None req-5d25cf99-1c48-4157-a11d-21287ca1b7ca tempest-AttachSCSIVolumeTestJSON-1319344340 tempest-AttachSCSIVolumeTestJSON-1319344340-project-member] Calling method '>' {{(pid=61306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 03:49:36 user devstack@n-api.service[61306]: DEBUG nova.compute.api [None req-5d25cf99-1c48-4157-a11d-21287ca1b7ca tempest-AttachSCSIVolumeTestJSON-1319344340 tempest-AttachSCSIVolumeTestJSON-1319344340-project-member] [instance: ba71c9bf-4d96-4fdc-8a55-cbdc75c29e72] Fetching instance by UUID {{(pid=61306) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 23 03:49:36 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-5d25cf99-1c48-4157-a11d-21287ca1b7ca tempest-AttachSCSIVolumeTestJSON-1319344340 tempest-AttachSCSIVolumeTestJSON-1319344340-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:49:36 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-5d25cf99-1c48-4157-a11d-21287ca1b7ca tempest-AttachSCSIVolumeTestJSON-1319344340 tempest-AttachSCSIVolumeTestJSON-1319344340-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:49:36 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-5d25cf99-1c48-4157-a11d-21287ca1b7ca tempest-AttachSCSIVolumeTestJSON-1319344340 tempest-AttachSCSIVolumeTestJSON-1319344340-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:49:36 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-5d25cf99-1c48-4157-a11d-21287ca1b7ca tempest-AttachSCSIVolumeTestJSON-1319344340 tempest-AttachSCSIVolumeTestJSON-1319344340-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:49:36 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-5d25cf99-1c48-4157-a11d-21287ca1b7ca tempest-AttachSCSIVolumeTestJSON-1319344340 tempest-AttachSCSIVolumeTestJSON-1319344340-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:49:36 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-5d25cf99-1c48-4157-a11d-21287ca1b7ca tempest-AttachSCSIVolumeTestJSON-1319344340 tempest-AttachSCSIVolumeTestJSON-1319344340-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:49:36 user devstack@n-api.service[61306]: INFO nova.api.openstack.wsgi [None req-5d25cf99-1c48-4157-a11d-21287ca1b7ca tempest-AttachSCSIVolumeTestJSON-1319344340 tempest-AttachSCSIVolumeTestJSON-1319344340-project-member] HTTP exception thrown: Instance ba71c9bf-4d96-4fdc-8a55-cbdc75c29e72 could not be found. Apr 23 03:49:36 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi [None req-5d25cf99-1c48-4157-a11d-21287ca1b7ca tempest-AttachSCSIVolumeTestJSON-1319344340 tempest-AttachSCSIVolumeTestJSON-1319344340-project-member] Request method failure captured: Apr 23 03:49:36 user devstack@n-api.service[61306]: request: GET /compute/v2.1/servers/ba71c9bf-4d96-4fdc-8a55-cbdc75c29e72 HTTP/1.1 Apr 23 03:49:36 user devstack@n-api.service[61306]: Accept: application/json Apr 23 03:49:36 user devstack@n-api.service[61306]: Accept-Encoding: identity Apr 23 03:49:36 user devstack@n-api.service[61306]: Connection: close Apr 23 03:49:36 user devstack@n-api.service[61306]: Content-Length: 0 Apr 23 03:49:36 user devstack@n-api.service[61306]: Content-Type: application/json Apr 23 03:49:36 user devstack@n-api.service[61306]: Host: 10.0.0.210 Apr 23 03:49:36 user devstack@n-api.service[61306]: Openstack-System-Scope: None Apr 23 03:49:36 user devstack@n-api.service[61306]: User-Agent: python-urllib3/1.26.15 Apr 23 03:49:36 user devstack@n-api.service[61306]: X-Auth-Token: gAAAAABkRKoNUoGxZ78vaaoxGOyAiDv0tiF8umVzHyD6H7rLrTS4LimOqwwELI8sh5v660FCVJiH7gaHDbRhra40jli9VGAtXUI9mUjPhcHWCUAo-HMnz7pw1L4O1mKJnbWKPVjW-hJZQnSqkPp2gsMNvqeUacDDP1gMW7tZekYKQBgOLdChWj8 Apr 23 03:49:36 user devstack@n-api.service[61306]: X-Domain-Id: None Apr 23 03:49:36 user devstack@n-api.service[61306]: X-Domain-Name: None Apr 23 03:49:36 user devstack@n-api.service[61306]: X-Identity-Status: Confirmed Apr 23 03:49:36 user devstack@n-api.service[61306]: X-Is-Admin-Project: True Apr 23 03:49:36 user devstack@n-api.service[61306]: X-Project-Domain-Id: default Apr 23 03:49:36 user devstack@n-api.service[61306]: X-Project-Domain-Name: Default Apr 23 03:49:36 user devstack@n-api.service[61306]: X-Project-Id: 0f253a2e878a45d99dd3cbda86c0c6ff Apr 23 03:49:36 user devstack@n-api.service[61306]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1319344340 Apr 23 03:49:36 user devstack@n-api.service[61306]: X-Role: reader,member Apr 23 03:49:36 user devstack@n-api.service[61306]: X-Roles: reader,member Apr 23 03:49:36 user devstack@n-api.service[61306]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0f253a2e878a45d99dd3cbda86c0c6ff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0f253a2e878a45d99dd3cbda86c0c6ff"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0f253a2e878a45d99dd3cbda86c0c6ff"}]}] Apr 23 03:49:36 user devstack@n-api.service[61306]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1319344340 Apr 23 03:49:36 user devstack@n-api.service[61306]: X-Tenant-Id: 0f253a2e878a45d99dd3cbda86c0c6ff Apr 23 03:49:36 user devstack@n-api.service[61306]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1319344340 Apr 23 03:49:36 user devstack@n-api.service[61306]: X-User: tempest-AttachSCSIVolumeTestJSON-1319344340-project-member Apr 23 03:49:36 user devstack@n-api.service[61306]: X-User-Domain-Id: default Apr 23 03:49:36 user devstack@n-api.service[61306]: X-User-Domain-Name: Default Apr 23 03:49:36 user devstack@n-api.service[61306]: X-User-Id: fc51570d0e7c4617ac6b8fa428b9660f Apr 23 03:49:36 user devstack@n-api.service[61306]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1319344340-project-member Apr 23 03:49:36 user devstack@n-api.service[61306]: method: > Apr 23 03:49:36 user devstack@n-api.service[61306]: exception: Instance ba71c9bf-4d96-4fdc-8a55-cbdc75c29e72 could not be found. Apr 23 03:49:36 user devstack@n-api.service[61306]: action_args: {'id': 'ba71c9bf-4d96-4fdc-8a55-cbdc75c29e72'} Apr 23 03:49:36 user devstack@n-api.service[61306]: {{(pid=61306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 23 03:49:36 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 23 03:49:36 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 23 03:49:36 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 23 03:49:36 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 23 03:49:36 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 23 03:49:36 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 23 03:49:36 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 23 03:49:36 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 23 03:49:36 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 23 03:49:36 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba71c9bf-4d96-4fdc-8a55-cbdc75c29e72 could not be found. Apr 23 03:49:36 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi Apr 23 03:49:36 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 23 03:49:36 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi Apr 23 03:49:36 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 23 03:49:36 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 23 03:49:36 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 23 03:49:36 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 23 03:49:36 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 23 03:49:36 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 23 03:49:36 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 23 03:49:36 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 23 03:49:36 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 23 03:49:36 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 23 03:49:36 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 23 03:49:36 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 23 03:49:36 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 23 03:49:36 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba71c9bf-4d96-4fdc-8a55-cbdc75c29e72 could not be found. Apr 23 03:49:36 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi Apr 23 03:49:36 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 23 03:49:36 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi Apr 23 03:49:36 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 23 03:49:36 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 23 03:49:36 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 23 03:49:36 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 23 03:49:36 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 23 03:49:36 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba71c9bf-4d96-4fdc-8a55-cbdc75c29e72 could not be found. Apr 23 03:49:36 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi Apr 23 03:49:36 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi [None req-5d25cf99-1c48-4157-a11d-21287ca1b7ca tempest-AttachSCSIVolumeTestJSON-1319344340 tempest-AttachSCSIVolumeTestJSON-1319344340-project-member] Returning 404 to user: Instance ba71c9bf-4d96-4fdc-8a55-cbdc75c29e72 could not be found. {{(pid=61306) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 23 03:49:36 user devstack@n-api.service[61306]: INFO nova.api.openstack.requestlog [None req-5d25cf99-1c48-4157-a11d-21287ca1b7ca tempest-AttachSCSIVolumeTestJSON-1319344340 tempest-AttachSCSIVolumeTestJSON-1319344340-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ba71c9bf-4d96-4fdc-8a55-cbdc75c29e72" status: 404 len: 111 microversion: 2.1 time: 0.028602 Apr 23 03:49:36 user devstack@n-api.service[61306]: [pid: 61306|app: 0|req: 60/178] 10.0.0.210 () {62 vars in 1313 bytes} [Sun Apr 23 03:49:36 2023] GET /compute/v2.1/servers/ba71c9bf-4d96-4fdc-8a55-cbdc75c29e72 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 23 03:49:44 user devstack@n-api.service[61307]: DEBUG dbcounter [-] [61307] Writing DB stats nova_cell1:SELECT=1 {{(pid=61307) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:49:44 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi [None req-b76a9b67-a9a4-4361-b2d6-383b16b444d1 tempest-VolumesGetTestJSON-344934767 tempest-VolumesGetTestJSON-344934767-project-member] Action: 'create', calling method: .version_select at 0x7f21e147ce50>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-2026025497", "metadata": {"Type": "work"}}} {{(pid=61307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 03:49:44 user devstack@n-api.service[61307]: INFO nova.api.openstack.requestlog [None req-b76a9b67-a9a4-4361-b2d6-383b16b444d1 tempest-VolumesGetTestJSON-344934767 tempest-VolumesGetTestJSON-344934767-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.504784 Apr 23 03:49:44 user devstack@n-api.service[61307]: [pid: 61307|app: 0|req: 59/179] 10.0.0.210 () {64 vars in 1233 bytes} [Sun Apr 23 03:49:44 2023] POST /compute/v2.1/os-volumes => generated 353 bytes in 506 msecs (HTTP/1.1 200) 10 headers in 447 bytes (1 switches on core 0) Apr 23 03:49:44 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi [None req-fccc56d6-1728-4576-83c3-c86b3893a7ed tempest-VolumesGetTestJSON-344934767 tempest-VolumesGetTestJSON-344934767-project-member] Calling method '.version_select at 0x7f21e128f010>' {{(pid=61308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 03:49:44 user devstack@n-api.service[61308]: INFO nova.api.openstack.requestlog [None req-fccc56d6-1728-4576-83c3-c86b3893a7ed tempest-VolumesGetTestJSON-344934767 tempest-VolumesGetTestJSON-344934767-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/e8668b6b-9366-4cbf-bceb-dd31335c8e2b" status: 200 len: 350 microversion: 2.1 time: 0.074896 Apr 23 03:49:44 user devstack@n-api.service[61308]: [pid: 61308|app: 0|req: 61/180] 10.0.0.210 () {62 vars in 1322 bytes} [Sun Apr 23 03:49:44 2023] GET /compute/v2.1/os-volumes/e8668b6b-9366-4cbf-bceb-dd31335c8e2b => generated 350 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 23 03:49:45 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi [None req-f86c8eec-9838-45c3-b10b-85b30827babc tempest-VolumesGetTestJSON-344934767 tempest-VolumesGetTestJSON-344934767-project-member] Calling method '.version_select at 0x7f21e12b0dc0>' {{(pid=61306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 03:49:45 user devstack@n-api.service[61306]: INFO nova.api.openstack.requestlog [None req-f86c8eec-9838-45c3-b10b-85b30827babc tempest-VolumesGetTestJSON-344934767 tempest-VolumesGetTestJSON-344934767-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/e8668b6b-9366-4cbf-bceb-dd31335c8e2b" status: 200 len: 350 microversion: 2.1 time: 0.059782 Apr 23 03:49:45 user devstack@n-api.service[61306]: [pid: 61306|app: 0|req: 61/181] 10.0.0.210 () {62 vars in 1322 bytes} [Sun Apr 23 03:49:45 2023] GET /compute/v2.1/os-volumes/e8668b6b-9366-4cbf-bceb-dd31335c8e2b => generated 350 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 23 03:49:45 user devstack@n-api.service[61307]: DEBUG dbcounter [-] [61307] Writing DB stats nova_api:SELECT=4,nova_api:DELETE=1 {{(pid=61307) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:49:45 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi [None req-9a70d6e4-b4c3-46f6-8536-9b7497da52cb tempest-VolumesGetTestJSON-344934767 tempest-VolumesGetTestJSON-344934767-project-member] Calling method '.version_select at 0x7f21e12024d0>' {{(pid=61307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 03:49:45 user devstack@n-api.service[61307]: INFO nova.api.openstack.requestlog [None req-9a70d6e4-b4c3-46f6-8536-9b7497da52cb tempest-VolumesGetTestJSON-344934767 tempest-VolumesGetTestJSON-344934767-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/e8668b6b-9366-4cbf-bceb-dd31335c8e2b" status: 202 len: 0 microversion: 2.1 time: 0.140470 Apr 23 03:49:45 user devstack@n-api.service[61307]: [pid: 61307|app: 0|req: 60/182] 10.0.0.210 () {62 vars in 1325 bytes} [Sun Apr 23 03:49:45 2023] DELETE /compute/v2.1/os-volumes/e8668b6b-9366-4cbf-bceb-dd31335c8e2b => generated 0 bytes in 142 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 23 03:49:45 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi [None req-69a6a7a0-eb3a-4fd6-bd0b-16781c6f6ffa tempest-VolumesGetTestJSON-344934767 tempest-VolumesGetTestJSON-344934767-project-member] Calling method '.version_select at 0x7f21e111bd90>' {{(pid=61308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 03:49:45 user devstack@n-api.service[61308]: INFO nova.api.openstack.wsgi [None req-69a6a7a0-eb3a-4fd6-bd0b-16781c6f6ffa tempest-VolumesGetTestJSON-344934767 tempest-VolumesGetTestJSON-344934767-project-member] HTTP exception thrown: Volume e8668b6b-9366-4cbf-bceb-dd31335c8e2b could not be found. Apr 23 03:49:45 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi [None req-69a6a7a0-eb3a-4fd6-bd0b-16781c6f6ffa tempest-VolumesGetTestJSON-344934767 tempest-VolumesGetTestJSON-344934767-project-member] Request method failure captured: Apr 23 03:49:45 user devstack@n-api.service[61308]: request: GET /compute/v2.1/os-volumes/e8668b6b-9366-4cbf-bceb-dd31335c8e2b HTTP/1.1 Apr 23 03:49:45 user devstack@n-api.service[61308]: Accept: application/json Apr 23 03:49:45 user devstack@n-api.service[61308]: Accept-Encoding: identity Apr 23 03:49:45 user devstack@n-api.service[61308]: Connection: close Apr 23 03:49:45 user devstack@n-api.service[61308]: Content-Length: 0 Apr 23 03:49:45 user devstack@n-api.service[61308]: Content-Type: application/json Apr 23 03:49:45 user devstack@n-api.service[61308]: Host: 10.0.0.210 Apr 23 03:49:45 user devstack@n-api.service[61308]: Openstack-System-Scope: None Apr 23 03:49:45 user devstack@n-api.service[61308]: User-Agent: python-urllib3/1.26.15 Apr 23 03:49:45 user devstack@n-api.service[61308]: X-Auth-Token: gAAAAABkRKrXzaQhK-wRGnd9qTmuB8DWQGlq-1wkf8gGindQupx0w8v7s6yhQTeQ9mWoxSpt2p7_BCtIwTBr_DpNgVtZS9Ym0pU8nyvEOlMg5v43jpI3Cx7K_bZJdrgMz2Zo-NSjCZdpPokkRDFpAu0PV_5Jan0iFwbbtJmr22e4QPcjJXoxywk Apr 23 03:49:45 user devstack@n-api.service[61308]: X-Domain-Id: None Apr 23 03:49:45 user devstack@n-api.service[61308]: X-Domain-Name: None Apr 23 03:49:45 user devstack@n-api.service[61308]: X-Identity-Status: Confirmed Apr 23 03:49:45 user devstack@n-api.service[61308]: X-Is-Admin-Project: True Apr 23 03:49:45 user devstack@n-api.service[61308]: X-Project-Domain-Id: default Apr 23 03:49:45 user devstack@n-api.service[61308]: X-Project-Domain-Name: Default Apr 23 03:49:45 user devstack@n-api.service[61308]: X-Project-Id: 969418d214144f6e8b8b277fab7c1b76 Apr 23 03:49:45 user devstack@n-api.service[61308]: X-Project-Name: tempest-VolumesGetTestJSON-344934767 Apr 23 03:49:45 user devstack@n-api.service[61308]: X-Role: reader,member Apr 23 03:49:45 user devstack@n-api.service[61308]: X-Roles: reader,member Apr 23 03:49:45 user devstack@n-api.service[61308]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/969418d214144f6e8b8b277fab7c1b76"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/969418d214144f6e8b8b277fab7c1b76"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/969418d214144f6e8b8b277fab7c1b76"}]}] Apr 23 03:49:45 user devstack@n-api.service[61308]: X-Tenant: tempest-VolumesGetTestJSON-344934767 Apr 23 03:49:45 user devstack@n-api.service[61308]: X-Tenant-Id: 969418d214144f6e8b8b277fab7c1b76 Apr 23 03:49:45 user devstack@n-api.service[61308]: X-Tenant-Name: tempest-VolumesGetTestJSON-344934767 Apr 23 03:49:45 user devstack@n-api.service[61308]: X-User: tempest-VolumesGetTestJSON-344934767-project-member Apr 23 03:49:45 user devstack@n-api.service[61308]: X-User-Domain-Id: default Apr 23 03:49:45 user devstack@n-api.service[61308]: X-User-Domain-Name: Default Apr 23 03:49:45 user devstack@n-api.service[61308]: X-User-Id: c6f80b1c33e3406f8811e5a990978b42 Apr 23 03:49:45 user devstack@n-api.service[61308]: X-User-Name: tempest-VolumesGetTestJSON-344934767-project-member Apr 23 03:49:45 user devstack@n-api.service[61308]: method: Apr 23 03:49:45 user devstack@n-api.service[61308]: exception: Volume e8668b6b-9366-4cbf-bceb-dd31335c8e2b could not be found. Apr 23 03:49:45 user devstack@n-api.service[61308]: action_args: {'id': 'e8668b6b-9366-4cbf-bceb-dd31335c8e2b'} Apr 23 03:49:45 user devstack@n-api.service[61308]: {{(pid=61308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 23 03:49:45 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 23 03:49:45 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 23 03:49:45 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 23 03:49:45 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 23 03:49:45 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 23 03:49:45 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 23 03:49:45 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 23 03:49:45 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 23 03:49:45 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 23 03:49:45 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 23 03:49:45 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 23 03:49:45 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 23 03:49:45 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 23 03:49:45 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 23 03:49:45 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 23 03:49:45 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e8668b6b-9366-4cbf-bceb-dd31335c8e2b could not be found. (HTTP 404) (Request-ID: req-e3c87d16-034d-406e-9ca1-6f9d6fdc91e2) Apr 23 03:49:45 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi Apr 23 03:49:45 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 23 03:49:45 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi Apr 23 03:49:45 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 23 03:49:45 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 23 03:49:45 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 23 03:49:45 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 23 03:49:45 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 23 03:49:45 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 23 03:49:45 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 23 03:49:45 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 23 03:49:45 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 23 03:49:45 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 23 03:49:45 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 23 03:49:45 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 23 03:49:45 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 23 03:49:45 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 23 03:49:45 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 23 03:49:45 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 23 03:49:45 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 23 03:49:45 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 23 03:49:45 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 23 03:49:45 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 23 03:49:45 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 23 03:49:45 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 23 03:49:45 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 23 03:49:45 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e8668b6b-9366-4cbf-bceb-dd31335c8e2b could not be found. Apr 23 03:49:45 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi Apr 23 03:49:45 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 23 03:49:45 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi Apr 23 03:49:45 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 23 03:49:45 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 23 03:49:45 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 23 03:49:45 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 23 03:49:45 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 23 03:49:45 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 23 03:49:45 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 23 03:49:45 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 23 03:49:45 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 23 03:49:45 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 23 03:49:45 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 23 03:49:45 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e8668b6b-9366-4cbf-bceb-dd31335c8e2b could not be found. Apr 23 03:49:45 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi Apr 23 03:49:45 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 23 03:49:45 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi Apr 23 03:49:45 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 23 03:49:45 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 23 03:49:45 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 23 03:49:45 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 23 03:49:45 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 23 03:49:45 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e8668b6b-9366-4cbf-bceb-dd31335c8e2b could not be found. Apr 23 03:49:45 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi Apr 23 03:49:45 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi [None req-69a6a7a0-eb3a-4fd6-bd0b-16781c6f6ffa tempest-VolumesGetTestJSON-344934767 tempest-VolumesGetTestJSON-344934767-project-member] Returning 404 to user: Volume e8668b6b-9366-4cbf-bceb-dd31335c8e2b could not be found. {{(pid=61308) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 23 03:49:45 user devstack@n-api.service[61308]: INFO nova.api.openstack.requestlog [None req-69a6a7a0-eb3a-4fd6-bd0b-16781c6f6ffa tempest-VolumesGetTestJSON-344934767 tempest-VolumesGetTestJSON-344934767-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/e8668b6b-9366-4cbf-bceb-dd31335c8e2b" status: 404 len: 109 microversion: 2.1 time: 0.034621 Apr 23 03:49:45 user devstack@n-api.service[61308]: [pid: 61308|app: 0|req: 62/183] 10.0.0.210 () {62 vars in 1322 bytes} [Sun Apr 23 03:49:45 2023] GET /compute/v2.1/os-volumes/e8668b6b-9366-4cbf-bceb-dd31335c8e2b => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 23 03:49:57 user devstack@n-api.service[61306]: DEBUG dbcounter [-] [61306] Writing DB stats nova_api:SELECT=3 {{(pid=61306) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:49:57 user devstack@n-api.service[61306]: DEBUG dbcounter [-] [61306] Writing DB stats nova_cell1:SELECT=3 {{(pid=61306) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:49:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi [None req-257223d6-3eee-4b20-bee8-0805d7099ced tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Calling method '>' {{(pid=61306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 03:49:57 user devstack@n-api.service[61306]: DEBUG nova.compute.api [None req-257223d6-3eee-4b20-bee8-0805d7099ced tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] [instance: c8480a7c-b5de-4f66-a4f0-08fc679b0dfd] Fetching instance by UUID {{(pid=61306) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 23 03:49:57 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-257223d6-3eee-4b20-bee8-0805d7099ced tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:49:57 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-257223d6-3eee-4b20-bee8-0805d7099ced tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:49:57 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-257223d6-3eee-4b20-bee8-0805d7099ced tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:49:57 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-257223d6-3eee-4b20-bee8-0805d7099ced tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:49:57 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-257223d6-3eee-4b20-bee8-0805d7099ced tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:49:57 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-257223d6-3eee-4b20-bee8-0805d7099ced tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:49:57 user devstack@n-api.service[61306]: DEBUG nova.policy [None req-257223d6-3eee-4b20-bee8-0805d7099ced tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99495726467944c38620831fc93e2856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79e09b1c4ae4cc5ab11c3e56ee4f0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61306) authorize /opt/stack/nova/nova/policy.py:203}} Apr 23 03:49:57 user devstack@n-api.service[61306]: DEBUG nova.policy [None req-257223d6-3eee-4b20-bee8-0805d7099ced tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99495726467944c38620831fc93e2856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79e09b1c4ae4cc5ab11c3e56ee4f0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61306) authorize /opt/stack/nova/nova/policy.py:203}} Apr 23 03:49:57 user devstack@n-api.service[61306]: DEBUG nova.policy [None req-257223d6-3eee-4b20-bee8-0805d7099ced tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99495726467944c38620831fc93e2856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79e09b1c4ae4cc5ab11c3e56ee4f0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61306) authorize /opt/stack/nova/nova/policy.py:203}} Apr 23 03:49:57 user devstack@n-api.service[61306]: INFO nova.api.openstack.requestlog [None req-257223d6-3eee-4b20-bee8-0805d7099ced tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c8480a7c-b5de-4f66-a4f0-08fc679b0dfd" status: 200 len: 1691 microversion: 2.87 time: 0.283355 Apr 23 03:49:57 user devstack@n-api.service[61306]: [pid: 61306|app: 0|req: 62/184] 10.0.0.210 () {64 vars in 1354 bytes} [Sun Apr 23 03:49:57 2023] GET /compute/v2.1/servers/c8480a7c-b5de-4f66-a4f0-08fc679b0dfd => generated 1691 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 23 03:49:59 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi [None req-468e1f2d-7146-4650-8054-52aed4c1d0de tempest-ServerStableDeviceRescueTest-847110386 tempest-ServerStableDeviceRescueTest-847110386-project-member] Calling method '>' {{(pid=61307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 03:49:59 user devstack@n-api.service[61307]: DEBUG nova.compute.api [None req-468e1f2d-7146-4650-8054-52aed4c1d0de tempest-ServerStableDeviceRescueTest-847110386 tempest-ServerStableDeviceRescueTest-847110386-project-member] [instance: f279f3d3-581d-4d6f-924f-4104ec23832a] Fetching instance by UUID {{(pid=61307) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 23 03:49:59 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-468e1f2d-7146-4650-8054-52aed4c1d0de tempest-ServerStableDeviceRescueTest-847110386 tempest-ServerStableDeviceRescueTest-847110386-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:49:59 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-468e1f2d-7146-4650-8054-52aed4c1d0de tempest-ServerStableDeviceRescueTest-847110386 tempest-ServerStableDeviceRescueTest-847110386-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:49:59 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-468e1f2d-7146-4650-8054-52aed4c1d0de tempest-ServerStableDeviceRescueTest-847110386 tempest-ServerStableDeviceRescueTest-847110386-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:49:59 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-468e1f2d-7146-4650-8054-52aed4c1d0de tempest-ServerStableDeviceRescueTest-847110386 tempest-ServerStableDeviceRescueTest-847110386-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:49:59 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-468e1f2d-7146-4650-8054-52aed4c1d0de tempest-ServerStableDeviceRescueTest-847110386 tempest-ServerStableDeviceRescueTest-847110386-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:49:59 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-468e1f2d-7146-4650-8054-52aed4c1d0de tempest-ServerStableDeviceRescueTest-847110386 tempest-ServerStableDeviceRescueTest-847110386-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:49:59 user devstack@n-api.service[61307]: DEBUG nova.policy [None req-468e1f2d-7146-4650-8054-52aed4c1d0de tempest-ServerStableDeviceRescueTest-847110386 tempest-ServerStableDeviceRescueTest-847110386-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3311b6ae249f41269fde041f6e441840', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5864626fffa7443c800b244471966d65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61307) authorize /opt/stack/nova/nova/policy.py:203}} Apr 23 03:49:59 user devstack@n-api.service[61307]: INFO nova.api.openstack.requestlog [None req-468e1f2d-7146-4650-8054-52aed4c1d0de tempest-ServerStableDeviceRescueTest-847110386 tempest-ServerStableDeviceRescueTest-847110386-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f279f3d3-581d-4d6f-924f-4104ec23832a" status: 200 len: 1670 microversion: 2.1 time: 0.233544 Apr 23 03:49:59 user devstack@n-api.service[61307]: [pid: 61307|app: 0|req: 61/185] 10.0.0.210 () {62 vars in 1313 bytes} [Sun Apr 23 03:49:59 2023] GET /compute/v2.1/servers/f279f3d3-581d-4d6f-924f-4104ec23832a => generated 1670 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 23 03:50:00 user devstack@n-api.service[61308]: DEBUG dbcounter [-] [61308] Writing DB stats nova_api:SELECT=3 {{(pid=61308) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:50:00 user devstack@n-api.service[61308]: DEBUG dbcounter [-] [61308] Writing DB stats nova_cell1:SELECT=43,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61308) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:50:00 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi [None req-2e4f5036-2e7c-4051-90d4-0940338f0f9c tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] Calling method '>' {{(pid=61308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 03:50:00 user devstack@n-api.service[61308]: DEBUG nova.compute.api [None req-2e4f5036-2e7c-4051-90d4-0940338f0f9c tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] [instance: 6ee9a44e-e6af-4eec-975c-3991146ce71b] Fetching instance by UUID {{(pid=61308) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 23 03:50:00 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-2e4f5036-2e7c-4051-90d4-0940338f0f9c tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:50:00 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-2e4f5036-2e7c-4051-90d4-0940338f0f9c tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:50:00 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-2e4f5036-2e7c-4051-90d4-0940338f0f9c tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:50:00 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-2e4f5036-2e7c-4051-90d4-0940338f0f9c tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:50:00 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-2e4f5036-2e7c-4051-90d4-0940338f0f9c tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:50:00 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-2e4f5036-2e7c-4051-90d4-0940338f0f9c tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:50:00 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi [None req-93f58181-786c-4808-9714-c72f3ad088fc tempest-ServerStableDeviceRescueTest-847110386 tempest-ServerStableDeviceRescueTest-847110386-project-member] Calling method '.version_select at 0x7f21e12b16c0>' {{(pid=61306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 03:50:00 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi [None req-2af98362-37f6-4145-b72f-4297738256b9 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Calling method '>' {{(pid=61307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 03:50:00 user devstack@n-api.service[61307]: DEBUG nova.compute.api [None req-2af98362-37f6-4145-b72f-4297738256b9 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] [instance: 3ec36a95-88ce-4ed1-9726-7e6d98674dec] Fetching instance by UUID {{(pid=61307) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 23 03:50:00 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-2af98362-37f6-4145-b72f-4297738256b9 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:50:00 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-2af98362-37f6-4145-b72f-4297738256b9 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:50:00 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-2af98362-37f6-4145-b72f-4297738256b9 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:50:00 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-2af98362-37f6-4145-b72f-4297738256b9 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:50:00 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-2af98362-37f6-4145-b72f-4297738256b9 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:50:00 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-2af98362-37f6-4145-b72f-4297738256b9 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:50:00 user devstack@n-api.service[61307]: INFO nova.api.openstack.wsgi [None req-2af98362-37f6-4145-b72f-4297738256b9 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] HTTP exception thrown: Instance 3ec36a95-88ce-4ed1-9726-7e6d98674dec could not be found. Apr 23 03:50:00 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi [None req-2af98362-37f6-4145-b72f-4297738256b9 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Request method failure captured: Apr 23 03:50:00 user devstack@n-api.service[61307]: request: GET /compute/v2.1/servers/3ec36a95-88ce-4ed1-9726-7e6d98674dec HTTP/1.1 Apr 23 03:50:00 user devstack@n-api.service[61307]: Accept: application/json Apr 23 03:50:00 user devstack@n-api.service[61307]: Accept-Encoding: identity Apr 23 03:50:00 user devstack@n-api.service[61307]: Connection: close Apr 23 03:50:00 user devstack@n-api.service[61307]: Content-Length: 0 Apr 23 03:50:00 user devstack@n-api.service[61307]: Content-Type: application/json Apr 23 03:50:00 user devstack@n-api.service[61307]: Host: 10.0.0.210 Apr 23 03:50:00 user devstack@n-api.service[61307]: Openstack-System-Scope: None Apr 23 03:50:00 user devstack@n-api.service[61307]: User-Agent: python-urllib3/1.26.15 Apr 23 03:50:00 user devstack@n-api.service[61307]: X-Auth-Token: gAAAAABkRKpATlQnMMf7AtMe3Mh47zSQG6r9ePVSL6VRK9keRxp6Gc7HMzsz_tP8tNowWY8eeXU0HpQXr0oDoCaKK212ZCUgOzicpa4lTfvIkKDveVvGHNmHGf_zIb8xjb2T8bafSts450cf0HsaSh4WH6WoE9_DYKPyo7TkDFQdEsMNjyWu92U Apr 23 03:50:00 user devstack@n-api.service[61307]: X-Domain-Id: None Apr 23 03:50:00 user devstack@n-api.service[61307]: X-Domain-Name: None Apr 23 03:50:00 user devstack@n-api.service[61307]: X-Identity-Status: Confirmed Apr 23 03:50:00 user devstack@n-api.service[61307]: X-Is-Admin-Project: True Apr 23 03:50:00 user devstack@n-api.service[61307]: X-Project-Domain-Id: default Apr 23 03:50:00 user devstack@n-api.service[61307]: X-Project-Domain-Name: Default Apr 23 03:50:00 user devstack@n-api.service[61307]: X-Project-Id: 24fff486a500421397ecb935828582cd Apr 23 03:50:00 user devstack@n-api.service[61307]: X-Project-Name: tempest-AttachVolumeNegativeTest-636753786 Apr 23 03:50:00 user devstack@n-api.service[61307]: X-Role: reader,member Apr 23 03:50:00 user devstack@n-api.service[61307]: X-Roles: reader,member Apr 23 03:50:00 user devstack@n-api.service[61307]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/24fff486a500421397ecb935828582cd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/24fff486a500421397ecb935828582cd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/24fff486a500421397ecb935828582cd"}]}] Apr 23 03:50:00 user devstack@n-api.service[61307]: X-Tenant: tempest-AttachVolumeNegativeTest-636753786 Apr 23 03:50:00 user devstack@n-api.service[61307]: X-Tenant-Id: 24fff486a500421397ecb935828582cd Apr 23 03:50:00 user devstack@n-api.service[61307]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-636753786 Apr 23 03:50:00 user devstack@n-api.service[61307]: X-User: tempest-AttachVolumeNegativeTest-636753786-project-member Apr 23 03:50:00 user devstack@n-api.service[61307]: X-User-Domain-Id: default Apr 23 03:50:00 user devstack@n-api.service[61307]: X-User-Domain-Name: Default Apr 23 03:50:00 user devstack@n-api.service[61307]: X-User-Id: 0a2c459cad014b07b2613e5e261d88aa Apr 23 03:50:00 user devstack@n-api.service[61307]: X-User-Name: tempest-AttachVolumeNegativeTest-636753786-project-member Apr 23 03:50:00 user devstack@n-api.service[61307]: method: > Apr 23 03:50:00 user devstack@n-api.service[61307]: exception: Instance 3ec36a95-88ce-4ed1-9726-7e6d98674dec could not be found. Apr 23 03:50:00 user devstack@n-api.service[61307]: action_args: {'id': '3ec36a95-88ce-4ed1-9726-7e6d98674dec'} Apr 23 03:50:00 user devstack@n-api.service[61307]: {{(pid=61307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 23 03:50:00 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 23 03:50:00 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 23 03:50:00 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 23 03:50:00 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 23 03:50:00 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 23 03:50:00 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 23 03:50:00 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 23 03:50:00 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 23 03:50:00 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 23 03:50:00 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ec36a95-88ce-4ed1-9726-7e6d98674dec could not be found. Apr 23 03:50:00 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi Apr 23 03:50:00 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 23 03:50:00 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi Apr 23 03:50:00 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 23 03:50:00 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 23 03:50:00 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 23 03:50:00 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 23 03:50:00 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 23 03:50:00 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 23 03:50:00 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 23 03:50:00 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 23 03:50:00 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 23 03:50:00 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 23 03:50:00 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 23 03:50:00 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 23 03:50:00 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 23 03:50:00 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ec36a95-88ce-4ed1-9726-7e6d98674dec could not be found. Apr 23 03:50:00 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi Apr 23 03:50:00 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 23 03:50:00 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi Apr 23 03:50:00 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 23 03:50:00 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 23 03:50:00 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 23 03:50:00 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 23 03:50:00 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 23 03:50:00 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ec36a95-88ce-4ed1-9726-7e6d98674dec could not be found. Apr 23 03:50:00 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi Apr 23 03:50:00 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi [None req-2af98362-37f6-4145-b72f-4297738256b9 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Returning 404 to user: Instance 3ec36a95-88ce-4ed1-9726-7e6d98674dec could not be found. {{(pid=61307) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 23 03:50:00 user devstack@n-api.service[61307]: INFO nova.api.openstack.requestlog [None req-2af98362-37f6-4145-b72f-4297738256b9 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3ec36a95-88ce-4ed1-9726-7e6d98674dec" status: 404 len: 111 microversion: 2.1 time: 0.029976 Apr 23 03:50:00 user devstack@n-api.service[61307]: [pid: 61307|app: 0|req: 62/186] 10.0.0.210 () {62 vars in 1313 bytes} [Sun Apr 23 03:50:00 2023] GET /compute/v2.1/servers/3ec36a95-88ce-4ed1-9726-7e6d98674dec => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 23 03:50:00 user devstack@n-api.service[61308]: DEBUG nova.policy [None req-2e4f5036-2e7c-4051-90d4-0940338f0f9c tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d689f1c160478ca83bbff3104d8ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b031ddc5c94ca98e7161de03bda4b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61308) authorize /opt/stack/nova/nova/policy.py:203}} Apr 23 03:50:00 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi [None req-ae7fdfc2-227f-4869-9b04-0451e3f4fd9e tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Calling method '.version_select at 0x7f21e1203a30>' {{(pid=61307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 03:50:00 user devstack@n-api.service[61308]: INFO nova.api.openstack.requestlog [None req-2e4f5036-2e7c-4051-90d4-0940338f0f9c tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6ee9a44e-e6af-4eec-975c-3991146ce71b" status: 200 len: 1536 microversion: 2.1 time: 0.241131 Apr 23 03:50:00 user devstack@n-api.service[61308]: [pid: 61308|app: 0|req: 63/187] 10.0.0.210 () {62 vars in 1313 bytes} [Sun Apr 23 03:50:00 2023] GET /compute/v2.1/servers/6ee9a44e-e6af-4eec-975c-3991146ce71b => generated 1536 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 23 03:50:00 user devstack@n-api.service[61307]: INFO nova.api.openstack.requestlog [None req-ae7fdfc2-227f-4869-9b04-0451e3f4fd9e tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2054139165" status: 202 len: 0 microversion: 2.1 time: 0.020542 Apr 23 03:50:00 user devstack@n-api.service[61307]: [pid: 61307|app: 0|req: 63/188] 10.0.0.210 () {62 vars in 1298 bytes} [Sun Apr 23 03:50:00 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2054139165 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 23 03:50:00 user devstack@n-api.service[61306]: INFO nova.api.openstack.requestlog [None req-93f58181-786c-4808-9714-c72f3ad088fc tempest-ServerStableDeviceRescueTest-847110386 tempest-ServerStableDeviceRescueTest-847110386-project-member] 10.0.0.210 "DELETE /compute/v2.1/images/ed2ff9e4-bed2-49af-99bb-51a7c0bfa96f" status: 204 len: 0 microversion: 2.1 time: 0.205769 Apr 23 03:50:00 user devstack@n-api.service[61306]: [pid: 61306|app: 0|req: 63/189] 10.0.0.210 () {62 vars in 1313 bytes} [Sun Apr 23 03:50:00 2023] DELETE /compute/v2.1/images/ed2ff9e4-bed2-49af-99bb-51a7c0bfa96f => generated 0 bytes in 207 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 23 03:50:00 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi [None req-65bb73b7-e327-4e9a-b28b-00d29524f938 tempest-ServerStableDeviceRescueTest-847110386 tempest-ServerStableDeviceRescueTest-847110386-project-member] Calling method '>' {{(pid=61308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 03:50:00 user devstack@n-api.service[61308]: DEBUG nova.compute.api [None req-65bb73b7-e327-4e9a-b28b-00d29524f938 tempest-ServerStableDeviceRescueTest-847110386 tempest-ServerStableDeviceRescueTest-847110386-project-member] [instance: f279f3d3-581d-4d6f-924f-4104ec23832a] Fetching instance by UUID {{(pid=61308) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 23 03:50:00 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-65bb73b7-e327-4e9a-b28b-00d29524f938 tempest-ServerStableDeviceRescueTest-847110386 tempest-ServerStableDeviceRescueTest-847110386-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:50:00 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-65bb73b7-e327-4e9a-b28b-00d29524f938 tempest-ServerStableDeviceRescueTest-847110386 tempest-ServerStableDeviceRescueTest-847110386-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:50:00 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-65bb73b7-e327-4e9a-b28b-00d29524f938 tempest-ServerStableDeviceRescueTest-847110386 tempest-ServerStableDeviceRescueTest-847110386-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:50:00 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-65bb73b7-e327-4e9a-b28b-00d29524f938 tempest-ServerStableDeviceRescueTest-847110386 tempest-ServerStableDeviceRescueTest-847110386-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:50:00 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-65bb73b7-e327-4e9a-b28b-00d29524f938 tempest-ServerStableDeviceRescueTest-847110386 tempest-ServerStableDeviceRescueTest-847110386-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:50:00 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-65bb73b7-e327-4e9a-b28b-00d29524f938 tempest-ServerStableDeviceRescueTest-847110386 tempest-ServerStableDeviceRescueTest-847110386-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:50:00 user devstack@n-api.service[61308]: DEBUG nova.compute.api [None req-65bb73b7-e327-4e9a-b28b-00d29524f938 tempest-ServerStableDeviceRescueTest-847110386 tempest-ServerStableDeviceRescueTest-847110386-project-member] [instance: f279f3d3-581d-4d6f-924f-4104ec23832a] Going to try to terminate instance {{(pid=61308) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 23 03:50:01 user devstack@n-api.service[61308]: INFO nova.api.openstack.requestlog [None req-65bb73b7-e327-4e9a-b28b-00d29524f938 tempest-ServerStableDeviceRescueTest-847110386 tempest-ServerStableDeviceRescueTest-847110386-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f279f3d3-581d-4d6f-924f-4104ec23832a" status: 204 len: 0 microversion: 2.1 time: 0.164733 Apr 23 03:50:01 user devstack@n-api.service[61308]: [pid: 61308|app: 0|req: 64/190] 10.0.0.210 () {62 vars in 1316 bytes} [Sun Apr 23 03:50:00 2023] DELETE /compute/v2.1/servers/f279f3d3-581d-4d6f-924f-4104ec23832a => generated 0 bytes in 166 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 23 03:50:01 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi [None req-be3bf303-9511-46b7-998d-652bb92b8446 tempest-ServerStableDeviceRescueTest-847110386 tempest-ServerStableDeviceRescueTest-847110386-project-member] Calling method '>' {{(pid=61307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 03:50:01 user devstack@n-api.service[61307]: DEBUG nova.compute.api [None req-be3bf303-9511-46b7-998d-652bb92b8446 tempest-ServerStableDeviceRescueTest-847110386 tempest-ServerStableDeviceRescueTest-847110386-project-member] [instance: f279f3d3-581d-4d6f-924f-4104ec23832a] Fetching instance by UUID {{(pid=61307) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 23 03:50:01 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-be3bf303-9511-46b7-998d-652bb92b8446 tempest-ServerStableDeviceRescueTest-847110386 tempest-ServerStableDeviceRescueTest-847110386-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:50:01 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-be3bf303-9511-46b7-998d-652bb92b8446 tempest-ServerStableDeviceRescueTest-847110386 tempest-ServerStableDeviceRescueTest-847110386-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:50:01 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-be3bf303-9511-46b7-998d-652bb92b8446 tempest-ServerStableDeviceRescueTest-847110386 tempest-ServerStableDeviceRescueTest-847110386-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:50:01 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-be3bf303-9511-46b7-998d-652bb92b8446 tempest-ServerStableDeviceRescueTest-847110386 tempest-ServerStableDeviceRescueTest-847110386-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:50:01 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-be3bf303-9511-46b7-998d-652bb92b8446 tempest-ServerStableDeviceRescueTest-847110386 tempest-ServerStableDeviceRescueTest-847110386-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:50:01 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-be3bf303-9511-46b7-998d-652bb92b8446 tempest-ServerStableDeviceRescueTest-847110386 tempest-ServerStableDeviceRescueTest-847110386-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:50:01 user devstack@n-api.service[61307]: DEBUG nova.policy [None req-be3bf303-9511-46b7-998d-652bb92b8446 tempest-ServerStableDeviceRescueTest-847110386 tempest-ServerStableDeviceRescueTest-847110386-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3311b6ae249f41269fde041f6e441840', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5864626fffa7443c800b244471966d65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61307) authorize /opt/stack/nova/nova/policy.py:203}} Apr 23 03:50:01 user devstack@n-api.service[61307]: INFO nova.api.openstack.requestlog [None req-be3bf303-9511-46b7-998d-652bb92b8446 tempest-ServerStableDeviceRescueTest-847110386 tempest-ServerStableDeviceRescueTest-847110386-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f279f3d3-581d-4d6f-924f-4104ec23832a" status: 200 len: 1676 microversion: 2.1 time: 0.174791 Apr 23 03:50:01 user devstack@n-api.service[61307]: [pid: 61307|app: 0|req: 64/191] 10.0.0.210 () {62 vars in 1313 bytes} [Sun Apr 23 03:50:01 2023] GET /compute/v2.1/servers/f279f3d3-581d-4d6f-924f-4104ec23832a => generated 1676 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 23 03:50:01 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi [req-0c155426-8849-4eb7-9195-b0276817b80a req-0ee2f97a-50e4-4f04-bbb9-5079c563ca98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f279f3d3-581d-4d6f-924f-4104ec23832a", "name": "network-vif-unplugged", "status": "completed", "tag": "680802e3-0304-496f-927b-855e4167272b"}]} {{(pid=61306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 03:50:01 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [req-0c155426-8849-4eb7-9195-b0276817b80a req-0ee2f97a-50e4-4f04-bbb9-5079c563ca98 service nova] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:50:01 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [req-0c155426-8849-4eb7-9195-b0276817b80a req-0ee2f97a-50e4-4f04-bbb9-5079c563ca98 service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:50:01 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [req-0c155426-8849-4eb7-9195-b0276817b80a req-0ee2f97a-50e4-4f04-bbb9-5079c563ca98 service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:50:01 user devstack@n-api.service[61306]: INFO nova.api.openstack.compute.server_external_events [req-0c155426-8849-4eb7-9195-b0276817b80a req-0ee2f97a-50e4-4f04-bbb9-5079c563ca98 service nova] Creating event network-vif-unplugged:680802e3-0304-496f-927b-855e4167272b for instance f279f3d3-581d-4d6f-924f-4104ec23832a on user Apr 23 03:50:01 user devstack@n-api.service[61306]: INFO nova.api.openstack.requestlog [req-0c155426-8849-4eb7-9195-b0276817b80a req-0ee2f97a-50e4-4f04-bbb9-5079c563ca98 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036591 Apr 23 03:50:01 user devstack@n-api.service[61306]: [pid: 61306|app: 0|req: 64/192] 10.0.0.210 () {68 vars in 1394 bytes} [Sun Apr 23 03:50:01 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 23 03:50:02 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi [None req-44acb179-b7e9-41b5-b8b6-61c53547fd3a tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Action: 'create', calling method: .version_select at 0x7f21e14370a0>, body: {"keypair": {"name": "tempest-keypair-152318519", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPW+NA3vXdFxJXRfoNCWzZ6Pz/y62h/Owo9QJnwMZPgQAIglks3olXUz15miaWu+L14NHfoTREI5jCse5O5kM4puAOyJ3IeJt0XKaKpq44fQskU03DPweyp4+IKVldZSew=="}} {{(pid=61308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 03:50:02 user devstack@n-api.service[61308]: DEBUG nova.quota [None req-44acb179-b7e9-41b5-b8b6-61c53547fd3a tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Getting quotas for project 24fff486a500421397ecb935828582cd. Resources: {'key_pairs'} {{(pid=61308) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 23 03:50:02 user devstack@n-api.service[61308]: DEBUG nova.quota [None req-44acb179-b7e9-41b5-b8b6-61c53547fd3a tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Getting quotas for user 0a2c459cad014b07b2613e5e261d88aa and project 24fff486a500421397ecb935828582cd. Resources: {'key_pairs'} {{(pid=61308) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 23 03:50:02 user devstack@n-api.service[61308]: INFO nova.api.openstack.requestlog [None req-44acb179-b7e9-41b5-b8b6-61c53547fd3a tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.045924 Apr 23 03:50:02 user devstack@n-api.service[61308]: [pid: 61308|app: 0|req: 65/193] 10.0.0.210 () {64 vars in 1236 bytes} [Sun Apr 23 03:50:02 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 23 03:50:03 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi [req-c2232ed9-086c-4156-84cf-053c07ae6d2d req-90ff6639-8075-4cd3-8af9-54858cf6638a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f279f3d3-581d-4d6f-924f-4104ec23832a", "name": "network-vif-plugged", "status": "completed", "tag": "680802e3-0304-496f-927b-855e4167272b"}, {"server_uuid": "f279f3d3-581d-4d6f-924f-4104ec23832a", "name": "network-vif-deleted", "tag": "680802e3-0304-496f-927b-855e4167272b"}]} {{(pid=61307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 03:50:03 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [req-c2232ed9-086c-4156-84cf-053c07ae6d2d req-90ff6639-8075-4cd3-8af9-54858cf6638a service nova] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:50:03 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [req-c2232ed9-086c-4156-84cf-053c07ae6d2d req-90ff6639-8075-4cd3-8af9-54858cf6638a service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:50:03 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [req-c2232ed9-086c-4156-84cf-053c07ae6d2d req-90ff6639-8075-4cd3-8af9-54858cf6638a service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:50:03 user devstack@n-api.service[61307]: INFO nova.api.openstack.compute.server_external_events [req-c2232ed9-086c-4156-84cf-053c07ae6d2d req-90ff6639-8075-4cd3-8af9-54858cf6638a service nova] Creating event network-vif-plugged:680802e3-0304-496f-927b-855e4167272b for instance f279f3d3-581d-4d6f-924f-4104ec23832a on user Apr 23 03:50:03 user devstack@n-api.service[61307]: INFO nova.api.openstack.compute.server_external_events [req-c2232ed9-086c-4156-84cf-053c07ae6d2d req-90ff6639-8075-4cd3-8af9-54858cf6638a service nova] Creating event network-vif-deleted:680802e3-0304-496f-927b-855e4167272b for instance f279f3d3-581d-4d6f-924f-4104ec23832a on user Apr 23 03:50:03 user devstack@n-api.service[61307]: INFO nova.api.openstack.requestlog [req-c2232ed9-086c-4156-84cf-053c07ae6d2d req-90ff6639-8075-4cd3-8af9-54858cf6638a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.029102 Apr 23 03:50:03 user devstack@n-api.service[61307]: [pid: 61307|app: 0|req: 65/194] 10.0.0.210 () {68 vars in 1394 bytes} [Sun Apr 23 03:50:03 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 23 03:50:03 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi [None req-f2f79885-bf1d-4bf5-9eb9-ec152a22fb51 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-458473256", "imageRef": "e6127373-9931-4277-9458-eceef653ea1e", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "6adb189c-9b46-4da4-a34b-31edf8685498"}], "security_groups": [{"name": "tempest-securitygroup--1639003520"}], "key_name": "tempest-keypair-152318519", "user_data": "}} {{(pid=61306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 03:50:03 user devstack@n-api.service[61306]: DEBUG nova.network.neutron [None req-f2f79885-bf1d-4bf5-9eb9-ec152a22fb51 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] validate_networks() for [('6adb189c-9b46-4da4-a34b-31edf8685498', None, None, None, None, None)] {{(pid=61306) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 23 03:50:04 user devstack@n-api.service[61306]: DEBUG nova.virt.hardware [None req-f2f79885-bf1d-4bf5-9eb9-ec152a22fb51 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Flavor limits 0:0:0 {{(pid=61306) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 23 03:50:04 user devstack@n-api.service[61306]: DEBUG nova.virt.hardware [None req-f2f79885-bf1d-4bf5-9eb9-ec152a22fb51 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Image limits 0:0:0 {{(pid=61306) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 23 03:50:04 user devstack@n-api.service[61306]: DEBUG nova.virt.hardware [None req-f2f79885-bf1d-4bf5-9eb9-ec152a22fb51 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Flavor pref 0:0:0 {{(pid=61306) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 23 03:50:04 user devstack@n-api.service[61306]: DEBUG nova.virt.hardware [None req-f2f79885-bf1d-4bf5-9eb9-ec152a22fb51 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Image pref 0:0:0 {{(pid=61306) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 23 03:50:04 user devstack@n-api.service[61306]: DEBUG nova.virt.hardware [None req-f2f79885-bf1d-4bf5-9eb9-ec152a22fb51 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61306) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 23 03:50:04 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-f2f79885-bf1d-4bf5-9eb9-ec152a22fb51 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:50:04 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-f2f79885-bf1d-4bf5-9eb9-ec152a22fb51 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:50:04 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-f2f79885-bf1d-4bf5-9eb9-ec152a22fb51 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:50:04 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-f2f79885-bf1d-4bf5-9eb9-ec152a22fb51 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:50:04 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-f2f79885-bf1d-4bf5-9eb9-ec152a22fb51 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:50:04 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-f2f79885-bf1d-4bf5-9eb9-ec152a22fb51 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:50:04 user devstack@n-api.service[61306]: DEBUG nova.quota [None req-f2f79885-bf1d-4bf5-9eb9-ec152a22fb51 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Getting quotas for project 24fff486a500421397ecb935828582cd. Resources: {'ram', 'instances', 'cores'} {{(pid=61306) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 23 03:50:04 user devstack@n-api.service[61306]: DEBUG nova.quota [None req-f2f79885-bf1d-4bf5-9eb9-ec152a22fb51 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Getting quotas for user 0a2c459cad014b07b2613e5e261d88aa and project 24fff486a500421397ecb935828582cd. Resources: {'ram', 'instances', 'cores'} {{(pid=61306) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 23 03:50:04 user devstack@n-api.service[61306]: DEBUG nova.compute.api [None req-f2f79885-bf1d-4bf5-9eb9-ec152a22fb51 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Going to run 1 instances... {{(pid=61306) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 23 03:50:04 user devstack@n-api.service[61306]: DEBUG nova.compute.api [None req-f2f79885-bf1d-4bf5-9eb9-ec152a22fb51 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] [instance: 7c1f1f24-62f5-4e51-8c74-b5b89b6585a4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e6127373-9931-4277-9458-eceef653ea1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61306) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 23 03:50:04 user devstack@n-api.service[61306]: INFO nova.api.openstack.requestlog [None req-f2f79885-bf1d-4bf5-9eb9-ec152a22fb51 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.692022 Apr 23 03:50:04 user devstack@n-api.service[61306]: [pid: 61306|app: 0|req: 65/195] 10.0.0.210 () {64 vars in 1224 bytes} [Sun Apr 23 03:50:03 2023] POST /compute/v2.1/servers => generated 400 bytes in 695 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 23 03:50:04 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi [None req-beca910f-8138-4cd4-b668-26f850d472b0 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Calling method '>' {{(pid=61308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 03:50:04 user devstack@n-api.service[61308]: DEBUG nova.compute.api [None req-beca910f-8138-4cd4-b668-26f850d472b0 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] [instance: 7c1f1f24-62f5-4e51-8c74-b5b89b6585a4] Fetching instance by UUID {{(pid=61308) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 23 03:50:04 user devstack@n-api.service[61308]: DEBUG nova.policy [None req-beca910f-8138-4cd4-b668-26f850d472b0 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2c459cad014b07b2613e5e261d88aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24fff486a500421397ecb935828582cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61308) authorize /opt/stack/nova/nova/policy.py:203}} Apr 23 03:50:04 user devstack@n-api.service[61308]: INFO nova.api.openstack.requestlog [None req-beca910f-8138-4cd4-b668-26f850d472b0 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7c1f1f24-62f5-4e51-8c74-b5b89b6585a4" status: 200 len: 1234 microversion: 2.1 time: 0.083289 Apr 23 03:50:04 user devstack@n-api.service[61308]: [pid: 61308|app: 0|req: 66/196] 10.0.0.210 () {62 vars in 1313 bytes} [Sun Apr 23 03:50:04 2023] GET /compute/v2.1/servers/7c1f1f24-62f5-4e51-8c74-b5b89b6585a4 => generated 1234 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 23 03:50:06 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi [req-1e806cd9-346a-4381-81c4-7eaf1ce7e076 req-5c4c5577-1afc-411f-a631-ed0150059205 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c1f1f24-62f5-4e51-8c74-b5b89b6585a4", "tag": "2a195833-5430-4cc1-a938-5b4157c32300"}]} {{(pid=61307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 03:50:06 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [req-1e806cd9-346a-4381-81c4-7eaf1ce7e076 req-5c4c5577-1afc-411f-a631-ed0150059205 service nova] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:50:06 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [req-1e806cd9-346a-4381-81c4-7eaf1ce7e076 req-5c4c5577-1afc-411f-a631-ed0150059205 service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:50:06 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [req-1e806cd9-346a-4381-81c4-7eaf1ce7e076 req-5c4c5577-1afc-411f-a631-ed0150059205 service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:50:06 user devstack@n-api.service[61307]: INFO nova.api.openstack.compute.server_external_events [req-1e806cd9-346a-4381-81c4-7eaf1ce7e076 req-5c4c5577-1afc-411f-a631-ed0150059205 service nova] Creating event network-changed:2a195833-5430-4cc1-a938-5b4157c32300 for instance 7c1f1f24-62f5-4e51-8c74-b5b89b6585a4 on user Apr 23 03:50:06 user devstack@n-api.service[61307]: INFO nova.api.openstack.requestlog [req-1e806cd9-346a-4381-81c4-7eaf1ce7e076 req-5c4c5577-1afc-411f-a631-ed0150059205 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030829 Apr 23 03:50:06 user devstack@n-api.service[61307]: [pid: 61307|app: 0|req: 66/197] 10.0.0.210 () {68 vars in 1394 bytes} [Sun Apr 23 03:50:06 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 23 03:50:08 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi [None req-8e207568-572a-44bd-9cb8-9310a1f1de82 tempest-VolumesAdminNegativeTest-594073230 tempest-VolumesAdminNegativeTest-594073230-project-member] Calling method '>' {{(pid=61306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 03:50:08 user devstack@n-api.service[61306]: DEBUG nova.compute.api [None req-8e207568-572a-44bd-9cb8-9310a1f1de82 tempest-VolumesAdminNegativeTest-594073230 tempest-VolumesAdminNegativeTest-594073230-project-member] [instance: 1d5ec75f-29f2-45c3-8d6e-74d9ec8b2f86] Fetching instance by UUID {{(pid=61306) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 23 03:50:08 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-8e207568-572a-44bd-9cb8-9310a1f1de82 tempest-VolumesAdminNegativeTest-594073230 tempest-VolumesAdminNegativeTest-594073230-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:50:08 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-8e207568-572a-44bd-9cb8-9310a1f1de82 tempest-VolumesAdminNegativeTest-594073230 tempest-VolumesAdminNegativeTest-594073230-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:50:08 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-8e207568-572a-44bd-9cb8-9310a1f1de82 tempest-VolumesAdminNegativeTest-594073230 tempest-VolumesAdminNegativeTest-594073230-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:50:08 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-8e207568-572a-44bd-9cb8-9310a1f1de82 tempest-VolumesAdminNegativeTest-594073230 tempest-VolumesAdminNegativeTest-594073230-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:50:08 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-8e207568-572a-44bd-9cb8-9310a1f1de82 tempest-VolumesAdminNegativeTest-594073230 tempest-VolumesAdminNegativeTest-594073230-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:50:08 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-8e207568-572a-44bd-9cb8-9310a1f1de82 tempest-VolumesAdminNegativeTest-594073230 tempest-VolumesAdminNegativeTest-594073230-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:50:08 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi [req-206e6118-e51b-4890-ba9b-aa0e48465a1d req-6d7ee72b-9d72-4cf9-9489-62345507ece8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c1f1f24-62f5-4e51-8c74-b5b89b6585a4", "name": "network-vif-plugged", "status": "completed", "tag": "2a195833-5430-4cc1-a938-5b4157c32300"}]} {{(pid=61308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 03:50:08 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [req-206e6118-e51b-4890-ba9b-aa0e48465a1d req-6d7ee72b-9d72-4cf9-9489-62345507ece8 service nova] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:50:08 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [req-206e6118-e51b-4890-ba9b-aa0e48465a1d req-6d7ee72b-9d72-4cf9-9489-62345507ece8 service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:50:08 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [req-206e6118-e51b-4890-ba9b-aa0e48465a1d req-6d7ee72b-9d72-4cf9-9489-62345507ece8 service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:50:08 user devstack@n-api.service[61308]: INFO nova.api.openstack.compute.server_external_events [req-206e6118-e51b-4890-ba9b-aa0e48465a1d req-6d7ee72b-9d72-4cf9-9489-62345507ece8 service nova] Creating event network-vif-plugged:2a195833-5430-4cc1-a938-5b4157c32300 for instance 7c1f1f24-62f5-4e51-8c74-b5b89b6585a4 on user Apr 23 03:50:08 user devstack@n-api.service[61308]: INFO nova.api.openstack.requestlog [req-206e6118-e51b-4890-ba9b-aa0e48465a1d req-6d7ee72b-9d72-4cf9-9489-62345507ece8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031448 Apr 23 03:50:08 user devstack@n-api.service[61308]: [pid: 61308|app: 0|req: 67/198] 10.0.0.210 () {68 vars in 1394 bytes} [Sun Apr 23 03:50:08 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 23 03:50:09 user devstack@n-api.service[61306]: DEBUG nova.policy [None req-8e207568-572a-44bd-9cb8-9310a1f1de82 tempest-VolumesAdminNegativeTest-594073230 tempest-VolumesAdminNegativeTest-594073230-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e80c354abd34bd3a28ddaeec9535af2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb0a03655cf4aa78e27c81ea4e1c424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61306) authorize /opt/stack/nova/nova/policy.py:203}} Apr 23 03:50:09 user devstack@n-api.service[61306]: INFO nova.api.openstack.requestlog [None req-8e207568-572a-44bd-9cb8-9310a1f1de82 tempest-VolumesAdminNegativeTest-594073230 tempest-VolumesAdminNegativeTest-594073230-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1d5ec75f-29f2-45c3-8d6e-74d9ec8b2f86" status: 200 len: 1496 microversion: 2.1 time: 0.254077 Apr 23 03:50:09 user devstack@n-api.service[61306]: [pid: 61306|app: 0|req: 66/199] 10.0.0.210 () {62 vars in 1313 bytes} [Sun Apr 23 03:50:08 2023] GET /compute/v2.1/servers/1d5ec75f-29f2-45c3-8d6e-74d9ec8b2f86 => generated 1496 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 23 03:50:11 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi [req-86777a4b-3b54-4cfe-9b3b-ab2d315b3c5d req-eb915423-c35e-4525-b974-c02529915c8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c1f1f24-62f5-4e51-8c74-b5b89b6585a4", "name": "network-vif-plugged", "status": "completed", "tag": "2a195833-5430-4cc1-a938-5b4157c32300"}]} {{(pid=61307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 03:50:11 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [req-86777a4b-3b54-4cfe-9b3b-ab2d315b3c5d req-eb915423-c35e-4525-b974-c02529915c8d service nova] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:50:11 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [req-86777a4b-3b54-4cfe-9b3b-ab2d315b3c5d req-eb915423-c35e-4525-b974-c02529915c8d service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:50:11 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [req-86777a4b-3b54-4cfe-9b3b-ab2d315b3c5d req-eb915423-c35e-4525-b974-c02529915c8d service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:50:11 user devstack@n-api.service[61307]: INFO nova.api.openstack.compute.server_external_events [req-86777a4b-3b54-4cfe-9b3b-ab2d315b3c5d req-eb915423-c35e-4525-b974-c02529915c8d service nova] Creating event network-vif-plugged:2a195833-5430-4cc1-a938-5b4157c32300 for instance 7c1f1f24-62f5-4e51-8c74-b5b89b6585a4 on user Apr 23 03:50:11 user devstack@n-api.service[61307]: INFO nova.api.openstack.requestlog [req-86777a4b-3b54-4cfe-9b3b-ab2d315b3c5d req-eb915423-c35e-4525-b974-c02529915c8d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038896 Apr 23 03:50:11 user devstack@n-api.service[61307]: [pid: 61307|app: 0|req: 67/200] 10.0.0.210 () {68 vars in 1394 bytes} [Sun Apr 23 03:50:11 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 23 03:50:11 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi [None req-99f5e4fe-167d-498a-9dbe-0b33a7322a98 tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] Calling method '>' {{(pid=61308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 03:50:11 user devstack@n-api.service[61308]: DEBUG nova.compute.api [None req-99f5e4fe-167d-498a-9dbe-0b33a7322a98 tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] [instance: 954f41b2-5c67-41a4-b38b-ebf3ad60cac7] Fetching instance by UUID {{(pid=61308) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 23 03:50:11 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-99f5e4fe-167d-498a-9dbe-0b33a7322a98 tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:50:11 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-99f5e4fe-167d-498a-9dbe-0b33a7322a98 tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:50:11 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-99f5e4fe-167d-498a-9dbe-0b33a7322a98 tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:50:11 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-99f5e4fe-167d-498a-9dbe-0b33a7322a98 tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:50:11 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-99f5e4fe-167d-498a-9dbe-0b33a7322a98 tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:50:11 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-99f5e4fe-167d-498a-9dbe-0b33a7322a98 tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:50:11 user devstack@n-api.service[61308]: DEBUG nova.policy [None req-99f5e4fe-167d-498a-9dbe-0b33a7322a98 tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdc8fe94058c46c28d4b3f16dc1e77ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f44fe9ba07e4e2f925d1a8952356e04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61308) authorize /opt/stack/nova/nova/policy.py:203}} Apr 23 03:50:11 user devstack@n-api.service[61308]: INFO nova.api.openstack.requestlog [None req-99f5e4fe-167d-498a-9dbe-0b33a7322a98 tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] 10.0.0.210 "GET /compute/v2.1/servers/954f41b2-5c67-41a4-b38b-ebf3ad60cac7" status: 200 len: 1658 microversion: 2.1 time: 0.251827 Apr 23 03:50:11 user devstack@n-api.service[61308]: [pid: 61308|app: 0|req: 68/201] 10.0.0.210 () {62 vars in 1313 bytes} [Sun Apr 23 03:50:11 2023] GET /compute/v2.1/servers/954f41b2-5c67-41a4-b38b-ebf3ad60cac7 => generated 1658 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 23 03:50:18 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi [None req-fff59767-b87d-4044-8744-4dcd48491bd1 tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] Calling method '>' {{(pid=61306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 03:50:18 user devstack@n-api.service[61306]: DEBUG nova.compute.api [None req-fff59767-b87d-4044-8744-4dcd48491bd1 tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] [instance: 6f7cf091-3140-4746-bd1c-95c42ea82f6e] Fetching instance by UUID {{(pid=61306) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 23 03:50:18 user devstack@n-api.service[61306]: DEBUG dbcounter [-] [61306] Writing DB stats nova_cell0:SELECT=2 {{(pid=61306) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:50:18 user devstack@n-api.service[61306]: DEBUG dbcounter [-] [61306] Writing DB stats nova_cell0:SELECT=6 {{(pid=61306) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:50:18 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-fff59767-b87d-4044-8744-4dcd48491bd1 tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:50:18 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-fff59767-b87d-4044-8744-4dcd48491bd1 tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:50:18 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-fff59767-b87d-4044-8744-4dcd48491bd1 tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:50:18 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-fff59767-b87d-4044-8744-4dcd48491bd1 tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:50:18 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-fff59767-b87d-4044-8744-4dcd48491bd1 tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:50:18 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-fff59767-b87d-4044-8744-4dcd48491bd1 tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:50:18 user devstack@n-api.service[61306]: INFO nova.api.openstack.wsgi [None req-fff59767-b87d-4044-8744-4dcd48491bd1 tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] HTTP exception thrown: Instance 6f7cf091-3140-4746-bd1c-95c42ea82f6e could not be found. Apr 23 03:50:18 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi [None req-fff59767-b87d-4044-8744-4dcd48491bd1 tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] Request method failure captured: Apr 23 03:50:18 user devstack@n-api.service[61306]: request: GET /compute/v2.1/servers/6f7cf091-3140-4746-bd1c-95c42ea82f6e HTTP/1.1 Apr 23 03:50:18 user devstack@n-api.service[61306]: Accept: application/json Apr 23 03:50:18 user devstack@n-api.service[61306]: Accept-Encoding: identity Apr 23 03:50:18 user devstack@n-api.service[61306]: Connection: close Apr 23 03:50:18 user devstack@n-api.service[61306]: Content-Length: 0 Apr 23 03:50:18 user devstack@n-api.service[61306]: Content-Type: application/json Apr 23 03:50:18 user devstack@n-api.service[61306]: Host: 10.0.0.210 Apr 23 03:50:18 user devstack@n-api.service[61306]: Openstack-System-Scope: None Apr 23 03:50:18 user devstack@n-api.service[61306]: User-Agent: python-urllib3/1.26.15 Apr 23 03:50:18 user devstack@n-api.service[61306]: X-Auth-Token: gAAAAABkRKpGsSgI3HJi_sm18U3cFUEuMdY0mnlrejsesmxtMa3yzukhJxxq_mWc4HtWGUcT7rcKBGD7PsBggR-8GP-uKD0bw-KmeHzKFuMPkka7MrICpRWdiO23-KB086cyB15LnVocRcuD82lRQme1YZIzB3Rf8FtwCsyiDCqB_H22XQNrKNc Apr 23 03:50:18 user devstack@n-api.service[61306]: X-Domain-Id: None Apr 23 03:50:18 user devstack@n-api.service[61306]: X-Domain-Name: None Apr 23 03:50:18 user devstack@n-api.service[61306]: X-Identity-Status: Confirmed Apr 23 03:50:18 user devstack@n-api.service[61306]: X-Is-Admin-Project: True Apr 23 03:50:18 user devstack@n-api.service[61306]: X-Project-Domain-Id: default Apr 23 03:50:18 user devstack@n-api.service[61306]: X-Project-Domain-Name: Default Apr 23 03:50:18 user devstack@n-api.service[61306]: X-Project-Id: 8ab0f01751954d04a83b360b2f839716 Apr 23 03:50:18 user devstack@n-api.service[61306]: X-Project-Name: tempest-TestMinimumBasicScenario-1558592168 Apr 23 03:50:18 user devstack@n-api.service[61306]: X-Role: reader,member Apr 23 03:50:18 user devstack@n-api.service[61306]: X-Roles: reader,member Apr 23 03:50:18 user devstack@n-api.service[61306]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8ab0f01751954d04a83b360b2f839716"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8ab0f01751954d04a83b360b2f839716"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/8ab0f01751954d04a83b360b2f839716"}]}] Apr 23 03:50:18 user devstack@n-api.service[61306]: X-Tenant: tempest-TestMinimumBasicScenario-1558592168 Apr 23 03:50:18 user devstack@n-api.service[61306]: X-Tenant-Id: 8ab0f01751954d04a83b360b2f839716 Apr 23 03:50:18 user devstack@n-api.service[61306]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1558592168 Apr 23 03:50:18 user devstack@n-api.service[61306]: X-User: tempest-TestMinimumBasicScenario-1558592168-project-member Apr 23 03:50:18 user devstack@n-api.service[61306]: X-User-Domain-Id: default Apr 23 03:50:18 user devstack@n-api.service[61306]: X-User-Domain-Name: Default Apr 23 03:50:18 user devstack@n-api.service[61306]: X-User-Id: 93a8dbfd8cef4578aff742813ffe901e Apr 23 03:50:18 user devstack@n-api.service[61306]: X-User-Name: tempest-TestMinimumBasicScenario-1558592168-project-member Apr 23 03:50:18 user devstack@n-api.service[61306]: method: > Apr 23 03:50:18 user devstack@n-api.service[61306]: exception: Instance 6f7cf091-3140-4746-bd1c-95c42ea82f6e could not be found. Apr 23 03:50:18 user devstack@n-api.service[61306]: action_args: {'id': '6f7cf091-3140-4746-bd1c-95c42ea82f6e'} Apr 23 03:50:18 user devstack@n-api.service[61306]: {{(pid=61306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 23 03:50:18 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 23 03:50:18 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 23 03:50:18 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 23 03:50:18 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 23 03:50:18 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 23 03:50:18 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 23 03:50:18 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 23 03:50:18 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 23 03:50:18 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 23 03:50:18 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f7cf091-3140-4746-bd1c-95c42ea82f6e could not be found. Apr 23 03:50:18 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi Apr 23 03:50:18 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 23 03:50:18 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi Apr 23 03:50:18 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 23 03:50:18 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 23 03:50:18 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 23 03:50:18 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 23 03:50:18 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 23 03:50:18 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 23 03:50:18 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 23 03:50:18 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 23 03:50:18 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 23 03:50:18 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 23 03:50:18 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 23 03:50:18 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 23 03:50:18 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 23 03:50:18 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f7cf091-3140-4746-bd1c-95c42ea82f6e could not be found. Apr 23 03:50:18 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi Apr 23 03:50:18 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 23 03:50:18 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi Apr 23 03:50:18 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 23 03:50:18 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 23 03:50:18 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 23 03:50:18 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 23 03:50:18 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 23 03:50:18 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f7cf091-3140-4746-bd1c-95c42ea82f6e could not be found. Apr 23 03:50:18 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi Apr 23 03:50:18 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi [None req-fff59767-b87d-4044-8744-4dcd48491bd1 tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] Returning 404 to user: Instance 6f7cf091-3140-4746-bd1c-95c42ea82f6e could not be found. {{(pid=61306) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 23 03:50:18 user devstack@n-api.service[61306]: INFO nova.api.openstack.requestlog [None req-fff59767-b87d-4044-8744-4dcd48491bd1 tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6f7cf091-3140-4746-bd1c-95c42ea82f6e" status: 404 len: 111 microversion: 2.1 time: 0.054096 Apr 23 03:50:18 user devstack@n-api.service[61306]: [pid: 61306|app: 0|req: 67/202] 10.0.0.210 () {62 vars in 1313 bytes} [Sun Apr 23 03:50:18 2023] GET /compute/v2.1/servers/6f7cf091-3140-4746-bd1c-95c42ea82f6e => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 23 03:50:18 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi [None req-0752025b-662a-4771-88bb-e0e6b3dc92ae tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] Calling method '.version_select at 0x7f21e1203010>' {{(pid=61307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 03:50:18 user devstack@n-api.service[61307]: INFO nova.api.openstack.requestlog [None req-0752025b-662a-4771-88bb-e0e6b3dc92ae tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1120445103" status: 202 len: 0 microversion: 2.1 time: 0.025156 Apr 23 03:50:18 user devstack@n-api.service[61307]: [pid: 61307|app: 0|req: 68/203] 10.0.0.210 () {62 vars in 1349 bytes} [Sun Apr 23 03:50:18 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1120445103 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 23 03:50:20 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi [None req-92760ee2-70b4-41a1-95b7-c0f86e78833c tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] Action: 'create', calling method: .version_select at 0x7f21e113a440>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-962162734", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIAmBt4gctDSizuDDJrh4pQ0geBulERx8NzMYT+fgBg4gRMdKT3R/5EiARevhCiAiWq2K21pOaqKy/T04eohZfy3bE6LZ/4YHDUN1RqyVnppPqbYR1ciJUTaIPmbmDg0QQ=="}} {{(pid=61308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 03:50:20 user devstack@n-api.service[61308]: DEBUG dbcounter [-] [61308] Writing DB stats nova_cell0:SELECT=6 {{(pid=61308) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:50:20 user devstack@n-api.service[61308]: DEBUG nova.quota [None req-92760ee2-70b4-41a1-95b7-c0f86e78833c tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] Getting quotas for project 8ab0f01751954d04a83b360b2f839716. Resources: {'key_pairs'} {{(pid=61308) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 23 03:50:20 user devstack@n-api.service[61308]: DEBUG nova.quota [None req-92760ee2-70b4-41a1-95b7-c0f86e78833c tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] Getting quotas for user 93a8dbfd8cef4578aff742813ffe901e and project 8ab0f01751954d04a83b360b2f839716. Resources: {'key_pairs'} {{(pid=61308) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 23 03:50:20 user devstack@n-api.service[61308]: INFO nova.api.openstack.requestlog [None req-92760ee2-70b4-41a1-95b7-c0f86e78833c tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.045940 Apr 23 03:50:20 user devstack@n-api.service[61308]: [pid: 61308|app: 0|req: 69/204] 10.0.0.210 () {64 vars in 1236 bytes} [Sun Apr 23 03:50:20 2023] POST /compute/v2.1/os-keypairs => generated 402 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 23 03:50:20 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi [None req-04800526-02b9-47fc-9ba4-542ab18461b2 tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-524528732", "imageRef": "9c1b8f6e-3455-4961-bbec-6a8a6708371c", "flavorRef": "42", "key_name": "tempest-TestMinimumBasicScenario-962162734", "networks": [{"uuid": "a603a26f-3b06-4792-80ae-73cea9f9d53b"}]}} {{(pid=61306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 03:50:21 user devstack@n-api.service[61306]: DEBUG nova.network.neutron [None req-04800526-02b9-47fc-9ba4-542ab18461b2 tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] validate_networks() for [('a603a26f-3b06-4792-80ae-73cea9f9d53b', None, None, None, None, None)] {{(pid=61306) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 23 03:50:21 user devstack@n-api.service[61306]: DEBUG nova.virt.hardware [None req-04800526-02b9-47fc-9ba4-542ab18461b2 tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] Flavor limits 0:0:0 {{(pid=61306) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 23 03:50:21 user devstack@n-api.service[61306]: DEBUG nova.virt.hardware [None req-04800526-02b9-47fc-9ba4-542ab18461b2 tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] Image limits 0:0:0 {{(pid=61306) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 23 03:50:21 user devstack@n-api.service[61306]: DEBUG nova.virt.hardware [None req-04800526-02b9-47fc-9ba4-542ab18461b2 tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] Flavor pref 0:0:0 {{(pid=61306) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 23 03:50:21 user devstack@n-api.service[61306]: DEBUG nova.virt.hardware [None req-04800526-02b9-47fc-9ba4-542ab18461b2 tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] Image pref 0:0:0 {{(pid=61306) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 23 03:50:21 user devstack@n-api.service[61306]: DEBUG nova.virt.hardware [None req-04800526-02b9-47fc-9ba4-542ab18461b2 tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61306) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 23 03:50:21 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-04800526-02b9-47fc-9ba4-542ab18461b2 tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:50:21 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-04800526-02b9-47fc-9ba4-542ab18461b2 tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:50:21 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-04800526-02b9-47fc-9ba4-542ab18461b2 tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:50:21 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-04800526-02b9-47fc-9ba4-542ab18461b2 tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:50:21 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-04800526-02b9-47fc-9ba4-542ab18461b2 tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:50:21 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-04800526-02b9-47fc-9ba4-542ab18461b2 tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:50:21 user devstack@n-api.service[61306]: DEBUG nova.quota [None req-04800526-02b9-47fc-9ba4-542ab18461b2 tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] Getting quotas for project 8ab0f01751954d04a83b360b2f839716. Resources: {'ram', 'instances', 'cores'} {{(pid=61306) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 23 03:50:21 user devstack@n-api.service[61306]: DEBUG nova.quota [None req-04800526-02b9-47fc-9ba4-542ab18461b2 tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] Getting quotas for user 93a8dbfd8cef4578aff742813ffe901e and project 8ab0f01751954d04a83b360b2f839716. Resources: {'ram', 'instances', 'cores'} {{(pid=61306) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 23 03:50:21 user devstack@n-api.service[61306]: DEBUG nova.compute.api [None req-04800526-02b9-47fc-9ba4-542ab18461b2 tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] Going to run 1 instances... {{(pid=61306) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 23 03:50:21 user devstack@n-api.service[61306]: DEBUG nova.compute.api [None req-04800526-02b9-47fc-9ba4-542ab18461b2 tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] [instance: 90cce4ec-f48c-408f-8d8f-46414bde01df] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9c1b8f6e-3455-4961-bbec-6a8a6708371c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61306) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 23 03:50:21 user devstack@n-api.service[61306]: INFO nova.api.openstack.requestlog [None req-04800526-02b9-47fc-9ba4-542ab18461b2 tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.570462 Apr 23 03:50:21 user devstack@n-api.service[61306]: [pid: 61306|app: 0|req: 68/205] 10.0.0.210 () {64 vars in 1224 bytes} [Sun Apr 23 03:50:20 2023] POST /compute/v2.1/servers => generated 378 bytes in 572 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 23 03:50:21 user devstack@n-api.service[61307]: DEBUG dbcounter [-] [61307] Writing DB stats nova_cell1:SELECT=20 {{(pid=61307) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:50:21 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi [None req-ea1b00db-81c6-450f-84e0-8326e565646e tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] Calling method '>' {{(pid=61307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 03:50:21 user devstack@n-api.service[61307]: DEBUG nova.compute.api [None req-ea1b00db-81c6-450f-84e0-8326e565646e tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] [instance: 90cce4ec-f48c-408f-8d8f-46414bde01df] Fetching instance by UUID {{(pid=61307) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 23 03:50:21 user devstack@n-api.service[61307]: DEBUG nova.policy [None req-ea1b00db-81c6-450f-84e0-8326e565646e tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93a8dbfd8cef4578aff742813ffe901e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab0f01751954d04a83b360b2f839716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61307) authorize /opt/stack/nova/nova/policy.py:203}} Apr 23 03:50:21 user devstack@n-api.service[61307]: INFO nova.api.openstack.requestlog [None req-ea1b00db-81c6-450f-84e0-8326e565646e tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] 10.0.0.210 "GET /compute/v2.1/servers/90cce4ec-f48c-408f-8d8f-46414bde01df" status: 200 len: 1251 microversion: 2.1 time: 0.076704 Apr 23 03:50:21 user devstack@n-api.service[61307]: [pid: 61307|app: 0|req: 69/206] 10.0.0.210 () {62 vars in 1313 bytes} [Sun Apr 23 03:50:21 2023] GET /compute/v2.1/servers/90cce4ec-f48c-408f-8d8f-46414bde01df => generated 1251 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 23 03:50:24 user devstack@n-api.service[61308]: DEBUG dbcounter [-] [61308] Writing DB stats nova_cell1:SELECT=29,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61308) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:50:24 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi [req-7a036921-e3aa-423d-b38f-d8342fc228d0 req-c23c84ae-f6dc-4fa6-b68b-34ec7207925f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90cce4ec-f48c-408f-8d8f-46414bde01df", "tag": "c9e332a6-c2c7-41d3-9646-e5f672d8cb95"}]} {{(pid=61308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 03:50:24 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [req-7a036921-e3aa-423d-b38f-d8342fc228d0 req-c23c84ae-f6dc-4fa6-b68b-34ec7207925f service nova] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:50:24 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [req-7a036921-e3aa-423d-b38f-d8342fc228d0 req-c23c84ae-f6dc-4fa6-b68b-34ec7207925f service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:50:24 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [req-7a036921-e3aa-423d-b38f-d8342fc228d0 req-c23c84ae-f6dc-4fa6-b68b-34ec7207925f service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:50:24 user devstack@n-api.service[61308]: INFO nova.api.openstack.compute.server_external_events [req-7a036921-e3aa-423d-b38f-d8342fc228d0 req-c23c84ae-f6dc-4fa6-b68b-34ec7207925f service nova] Creating event network-changed:c9e332a6-c2c7-41d3-9646-e5f672d8cb95 for instance 90cce4ec-f48c-408f-8d8f-46414bde01df on user Apr 23 03:50:24 user devstack@n-api.service[61308]: INFO nova.api.openstack.requestlog [req-7a036921-e3aa-423d-b38f-d8342fc228d0 req-c23c84ae-f6dc-4fa6-b68b-34ec7207925f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043441 Apr 23 03:50:24 user devstack@n-api.service[61308]: [pid: 61308|app: 0|req: 70/207] 10.0.0.210 () {68 vars in 1394 bytes} [Sun Apr 23 03:50:24 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 23 03:50:26 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi [req-029bd62a-173a-4f64-ad59-339e3e934bc1 req-e2a78a0b-7a45-47e9-b877-0bea9be271d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90cce4ec-f48c-408f-8d8f-46414bde01df", "name": "network-vif-plugged", "status": "completed", "tag": "c9e332a6-c2c7-41d3-9646-e5f672d8cb95"}]} {{(pid=61306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 03:50:26 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [req-029bd62a-173a-4f64-ad59-339e3e934bc1 req-e2a78a0b-7a45-47e9-b877-0bea9be271d2 service nova] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:50:26 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [req-029bd62a-173a-4f64-ad59-339e3e934bc1 req-e2a78a0b-7a45-47e9-b877-0bea9be271d2 service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:50:26 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [req-029bd62a-173a-4f64-ad59-339e3e934bc1 req-e2a78a0b-7a45-47e9-b877-0bea9be271d2 service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:50:26 user devstack@n-api.service[61306]: INFO nova.api.openstack.compute.server_external_events [req-029bd62a-173a-4f64-ad59-339e3e934bc1 req-e2a78a0b-7a45-47e9-b877-0bea9be271d2 service nova] Creating event network-vif-plugged:c9e332a6-c2c7-41d3-9646-e5f672d8cb95 for instance 90cce4ec-f48c-408f-8d8f-46414bde01df on user Apr 23 03:50:26 user devstack@n-api.service[61306]: INFO nova.api.openstack.requestlog [req-029bd62a-173a-4f64-ad59-339e3e934bc1 req-e2a78a0b-7a45-47e9-b877-0bea9be271d2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039494 Apr 23 03:50:26 user devstack@n-api.service[61306]: [pid: 61306|app: 0|req: 69/208] 10.0.0.210 () {68 vars in 1394 bytes} [Sun Apr 23 03:50:26 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 23 03:50:28 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi [req-02947cbb-5d2c-487b-a46e-a5b8d24ee39f req-5737e729-5163-4ba2-a4a0-2b71bd0111e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90cce4ec-f48c-408f-8d8f-46414bde01df", "name": "network-vif-plugged", "status": "completed", "tag": "c9e332a6-c2c7-41d3-9646-e5f672d8cb95"}]} {{(pid=61307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 03:50:28 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [req-02947cbb-5d2c-487b-a46e-a5b8d24ee39f req-5737e729-5163-4ba2-a4a0-2b71bd0111e3 service nova] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:50:28 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [req-02947cbb-5d2c-487b-a46e-a5b8d24ee39f req-5737e729-5163-4ba2-a4a0-2b71bd0111e3 service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:50:28 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [req-02947cbb-5d2c-487b-a46e-a5b8d24ee39f req-5737e729-5163-4ba2-a4a0-2b71bd0111e3 service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:50:28 user devstack@n-api.service[61307]: INFO nova.api.openstack.compute.server_external_events [req-02947cbb-5d2c-487b-a46e-a5b8d24ee39f req-5737e729-5163-4ba2-a4a0-2b71bd0111e3 service nova] Creating event network-vif-plugged:c9e332a6-c2c7-41d3-9646-e5f672d8cb95 for instance 90cce4ec-f48c-408f-8d8f-46414bde01df on user Apr 23 03:50:28 user devstack@n-api.service[61307]: INFO nova.api.openstack.requestlog [req-02947cbb-5d2c-487b-a46e-a5b8d24ee39f req-5737e729-5163-4ba2-a4a0-2b71bd0111e3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047997 Apr 23 03:50:28 user devstack@n-api.service[61307]: [pid: 61307|app: 0|req: 70/209] 10.0.0.210 () {68 vars in 1394 bytes} [Sun Apr 23 03:50:28 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 23 03:50:51 user devstack@n-api.service[61308]: DEBUG dbcounter [-] [61308] Writing DB stats nova_cell0:SELECT=4 {{(pid=61308) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:50:51 user devstack@n-api.service[61308]: DEBUG dbcounter [-] [61308] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1,nova_api:INSERT=2 {{(pid=61308) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:50:51 user devstack@n-api.service[61308]: DEBUG dbcounter [-] [61308] Writing DB stats nova_cell1:SELECT=2 {{(pid=61308) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:50:51 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi [None req-192456e2-969f-4887-be1f-81a1a2a96178 tempest-ServerStableDeviceRescueTest-847110386 tempest-ServerStableDeviceRescueTest-847110386-project-member] Calling method '>' {{(pid=61308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 03:50:51 user devstack@n-api.service[61308]: DEBUG nova.compute.api [None req-192456e2-969f-4887-be1f-81a1a2a96178 tempest-ServerStableDeviceRescueTest-847110386 tempest-ServerStableDeviceRescueTest-847110386-project-member] [instance: f279f3d3-581d-4d6f-924f-4104ec23832a] Fetching instance by UUID {{(pid=61308) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 23 03:50:51 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-192456e2-969f-4887-be1f-81a1a2a96178 tempest-ServerStableDeviceRescueTest-847110386 tempest-ServerStableDeviceRescueTest-847110386-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:50:51 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-192456e2-969f-4887-be1f-81a1a2a96178 tempest-ServerStableDeviceRescueTest-847110386 tempest-ServerStableDeviceRescueTest-847110386-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:50:51 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-192456e2-969f-4887-be1f-81a1a2a96178 tempest-ServerStableDeviceRescueTest-847110386 tempest-ServerStableDeviceRescueTest-847110386-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:50:51 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-192456e2-969f-4887-be1f-81a1a2a96178 tempest-ServerStableDeviceRescueTest-847110386 tempest-ServerStableDeviceRescueTest-847110386-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:50:51 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-192456e2-969f-4887-be1f-81a1a2a96178 tempest-ServerStableDeviceRescueTest-847110386 tempest-ServerStableDeviceRescueTest-847110386-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:50:51 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-192456e2-969f-4887-be1f-81a1a2a96178 tempest-ServerStableDeviceRescueTest-847110386 tempest-ServerStableDeviceRescueTest-847110386-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:50:51 user devstack@n-api.service[61308]: INFO nova.api.openstack.wsgi [None req-192456e2-969f-4887-be1f-81a1a2a96178 tempest-ServerStableDeviceRescueTest-847110386 tempest-ServerStableDeviceRescueTest-847110386-project-member] HTTP exception thrown: Instance f279f3d3-581d-4d6f-924f-4104ec23832a could not be found. Apr 23 03:50:51 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi [None req-192456e2-969f-4887-be1f-81a1a2a96178 tempest-ServerStableDeviceRescueTest-847110386 tempest-ServerStableDeviceRescueTest-847110386-project-member] Request method failure captured: Apr 23 03:50:51 user devstack@n-api.service[61308]: request: GET /compute/v2.1/servers/f279f3d3-581d-4d6f-924f-4104ec23832a HTTP/1.1 Apr 23 03:50:51 user devstack@n-api.service[61308]: Accept: application/json Apr 23 03:50:51 user devstack@n-api.service[61308]: Accept-Encoding: identity Apr 23 03:50:51 user devstack@n-api.service[61308]: Connection: close Apr 23 03:50:51 user devstack@n-api.service[61308]: Content-Length: 0 Apr 23 03:50:51 user devstack@n-api.service[61308]: Content-Type: application/json Apr 23 03:50:51 user devstack@n-api.service[61308]: Host: 10.0.0.210 Apr 23 03:50:51 user devstack@n-api.service[61308]: Openstack-System-Scope: None Apr 23 03:50:51 user devstack@n-api.service[61308]: User-Agent: python-urllib3/1.26.15 Apr 23 03:50:51 user devstack@n-api.service[61308]: X-Auth-Token: gAAAAABkRKn9YdeR3zbkEWTOIhAJUn7cG10Gx6w7neQiEwIheOtU11tohrNpLIMukbKF1SkCilLfmIjQPCxQhMTuQuNMl_DgcyZg7beJZ58cTFhb7TYXT9bPdWEtiJAZiEcZNAj76mbuvNsJknZH1oR3XWP5QS2amJ1CVgzm2R7bPvAH2oMgdAs Apr 23 03:50:51 user devstack@n-api.service[61308]: X-Domain-Id: None Apr 23 03:50:51 user devstack@n-api.service[61308]: X-Domain-Name: None Apr 23 03:50:51 user devstack@n-api.service[61308]: X-Identity-Status: Confirmed Apr 23 03:50:51 user devstack@n-api.service[61308]: X-Is-Admin-Project: True Apr 23 03:50:51 user devstack@n-api.service[61308]: X-Project-Domain-Id: default Apr 23 03:50:51 user devstack@n-api.service[61308]: X-Project-Domain-Name: Default Apr 23 03:50:51 user devstack@n-api.service[61308]: X-Project-Id: 5864626fffa7443c800b244471966d65 Apr 23 03:50:51 user devstack@n-api.service[61308]: X-Project-Name: tempest-ServerStableDeviceRescueTest-847110386 Apr 23 03:50:51 user devstack@n-api.service[61308]: X-Role: reader,member Apr 23 03:50:51 user devstack@n-api.service[61308]: X-Roles: reader,member Apr 23 03:50:51 user devstack@n-api.service[61308]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5864626fffa7443c800b244471966d65"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5864626fffa7443c800b244471966d65"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/5864626fffa7443c800b244471966d65"}]}] Apr 23 03:50:51 user devstack@n-api.service[61308]: X-Tenant: tempest-ServerStableDeviceRescueTest-847110386 Apr 23 03:50:51 user devstack@n-api.service[61308]: X-Tenant-Id: 5864626fffa7443c800b244471966d65 Apr 23 03:50:51 user devstack@n-api.service[61308]: X-Tenant-Name: tempest-ServerStableDeviceRescueTest-847110386 Apr 23 03:50:51 user devstack@n-api.service[61308]: X-User: tempest-ServerStableDeviceRescueTest-847110386-project-member Apr 23 03:50:51 user devstack@n-api.service[61308]: X-User-Domain-Id: default Apr 23 03:50:51 user devstack@n-api.service[61308]: X-User-Domain-Name: Default Apr 23 03:50:51 user devstack@n-api.service[61308]: X-User-Id: 3311b6ae249f41269fde041f6e441840 Apr 23 03:50:51 user devstack@n-api.service[61308]: X-User-Name: tempest-ServerStableDeviceRescueTest-847110386-project-member Apr 23 03:50:51 user devstack@n-api.service[61308]: method: > Apr 23 03:50:51 user devstack@n-api.service[61308]: exception: Instance f279f3d3-581d-4d6f-924f-4104ec23832a could not be found. Apr 23 03:50:51 user devstack@n-api.service[61308]: action_args: {'id': 'f279f3d3-581d-4d6f-924f-4104ec23832a'} Apr 23 03:50:51 user devstack@n-api.service[61308]: {{(pid=61308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 23 03:50:51 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 23 03:50:51 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 23 03:50:51 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 23 03:50:51 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 23 03:50:51 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 23 03:50:51 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 23 03:50:51 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 23 03:50:51 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 23 03:50:51 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 23 03:50:51 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f279f3d3-581d-4d6f-924f-4104ec23832a could not be found. Apr 23 03:50:51 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi Apr 23 03:50:51 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 23 03:50:51 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi Apr 23 03:50:51 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 23 03:50:51 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 23 03:50:51 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 23 03:50:51 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 23 03:50:51 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 23 03:50:51 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 23 03:50:51 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 23 03:50:51 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 23 03:50:51 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 23 03:50:51 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 23 03:50:51 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 23 03:50:51 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 23 03:50:51 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 23 03:50:51 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f279f3d3-581d-4d6f-924f-4104ec23832a could not be found. Apr 23 03:50:51 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi Apr 23 03:50:51 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 23 03:50:51 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi Apr 23 03:50:51 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 23 03:50:51 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 23 03:50:51 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 23 03:50:51 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 23 03:50:51 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 23 03:50:51 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f279f3d3-581d-4d6f-924f-4104ec23832a could not be found. Apr 23 03:50:51 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi Apr 23 03:50:51 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi [None req-192456e2-969f-4887-be1f-81a1a2a96178 tempest-ServerStableDeviceRescueTest-847110386 tempest-ServerStableDeviceRescueTest-847110386-project-member] Returning 404 to user: Instance f279f3d3-581d-4d6f-924f-4104ec23832a could not be found. {{(pid=61308) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 23 03:50:51 user devstack@n-api.service[61308]: INFO nova.api.openstack.requestlog [None req-192456e2-969f-4887-be1f-81a1a2a96178 tempest-ServerStableDeviceRescueTest-847110386 tempest-ServerStableDeviceRescueTest-847110386-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f279f3d3-581d-4d6f-924f-4104ec23832a" status: 404 len: 111 microversion: 2.1 time: 0.037758 Apr 23 03:50:51 user devstack@n-api.service[61308]: [pid: 61308|app: 0|req: 71/210] 10.0.0.210 () {62 vars in 1313 bytes} [Sun Apr 23 03:50:51 2023] GET /compute/v2.1/servers/f279f3d3-581d-4d6f-924f-4104ec23832a => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 23 03:50:51 user devstack@n-api.service[61306]: DEBUG dbcounter [-] [61306] Writing DB stats nova_cell0:SELECT=2 {{(pid=61306) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:50:51 user devstack@n-api.service[61306]: DEBUG dbcounter [-] [61306] Writing DB stats nova_cell0:SELECT=6 {{(pid=61306) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:50:51 user devstack@n-api.service[61306]: DEBUG dbcounter [-] [61306] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=6 {{(pid=61306) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:50:51 user devstack@n-api.service[61306]: DEBUG dbcounter [-] [61306] Writing DB stats nova_cell1:SELECT=22 {{(pid=61306) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:50:51 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi [None req-8d2c6548-5b00-4f1a-b5a9-b4fcd9ea5b42 tempest-ServerStableDeviceRescueTest-847110386 tempest-ServerStableDeviceRescueTest-847110386-project-member] Calling method '.version_select at 0x7f21e12b28c0>' {{(pid=61306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 03:50:51 user devstack@n-api.service[61306]: INFO nova.api.openstack.requestlog [None req-8d2c6548-5b00-4f1a-b5a9-b4fcd9ea5b42 tempest-ServerStableDeviceRescueTest-847110386 tempest-ServerStableDeviceRescueTest-847110386-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-884305512" status: 202 len: 0 microversion: 2.1 time: 0.030971 Apr 23 03:50:51 user devstack@n-api.service[61306]: [pid: 61306|app: 0|req: 70/211] 10.0.0.210 () {62 vars in 1295 bytes} [Sun Apr 23 03:50:51 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-884305512 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 23 03:50:54 user devstack@n-api.service[61307]: DEBUG dbcounter [-] [61307] Writing DB stats nova_cell0:SELECT=2 {{(pid=61307) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:50:54 user devstack@n-api.service[61307]: DEBUG dbcounter [-] [61307] Writing DB stats nova_api:SELECT=24,nova_api:DELETE=2 {{(pid=61307) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:50:54 user devstack@n-api.service[61307]: DEBUG dbcounter [-] [61307] Writing DB stats nova_cell1:SELECT=2 {{(pid=61307) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:50:54 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi [None req-3abf5d04-9737-4e9c-8dd0-e29144240b17 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Calling method '>' {{(pid=61307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 03:50:54 user devstack@n-api.service[61307]: DEBUG nova.compute.api [None req-3abf5d04-9737-4e9c-8dd0-e29144240b17 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] [instance: 7c1f1f24-62f5-4e51-8c74-b5b89b6585a4] Fetching instance by UUID {{(pid=61307) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 23 03:50:54 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-3abf5d04-9737-4e9c-8dd0-e29144240b17 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:50:54 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-3abf5d04-9737-4e9c-8dd0-e29144240b17 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:50:54 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-3abf5d04-9737-4e9c-8dd0-e29144240b17 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:50:54 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-3abf5d04-9737-4e9c-8dd0-e29144240b17 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:50:54 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-3abf5d04-9737-4e9c-8dd0-e29144240b17 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:50:54 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-3abf5d04-9737-4e9c-8dd0-e29144240b17 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:50:55 user devstack@n-api.service[61307]: DEBUG nova.policy [None req-3abf5d04-9737-4e9c-8dd0-e29144240b17 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2c459cad014b07b2613e5e261d88aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24fff486a500421397ecb935828582cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61307) authorize /opt/stack/nova/nova/policy.py:203}} Apr 23 03:50:55 user devstack@n-api.service[61307]: INFO nova.api.openstack.requestlog [None req-3abf5d04-9737-4e9c-8dd0-e29144240b17 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7c1f1f24-62f5-4e51-8c74-b5b89b6585a4" status: 200 len: 1544 microversion: 2.1 time: 0.651320 Apr 23 03:50:55 user devstack@n-api.service[61307]: [pid: 61307|app: 0|req: 71/212] 10.0.0.210 () {62 vars in 1313 bytes} [Sun Apr 23 03:50:54 2023] GET /compute/v2.1/servers/7c1f1f24-62f5-4e51-8c74-b5b89b6585a4 => generated 1544 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 23 03:50:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi [None req-a247a50c-ed92-4a55-b891-807e4a0481bb tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerBootFromVolumeStableRescueTest-image-516784752"}} {{(pid=61308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 03:50:57 user devstack@n-api.service[61308]: DEBUG nova.compute.api [None req-a247a50c-ed92-4a55-b891-807e4a0481bb tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] [instance: c8480a7c-b5de-4f66-a4f0-08fc679b0dfd] Fetching instance by UUID {{(pid=61308) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 23 03:50:57 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-a247a50c-ed92-4a55-b891-807e4a0481bb tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:50:57 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-a247a50c-ed92-4a55-b891-807e4a0481bb tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:50:57 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-a247a50c-ed92-4a55-b891-807e4a0481bb tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:50:57 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-a247a50c-ed92-4a55-b891-807e4a0481bb tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:50:57 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-a247a50c-ed92-4a55-b891-807e4a0481bb tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:50:57 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-a247a50c-ed92-4a55-b891-807e4a0481bb tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:50:58 user devstack@n-api.service[61308]: INFO nova.api.openstack.requestlog [None req-a247a50c-ed92-4a55-b891-807e4a0481bb tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] 10.0.0.210 "POST /compute/v2.1/servers/c8480a7c-b5de-4f66-a4f0-08fc679b0dfd/action" status: 202 len: 52 microversion: 2.87 time: 0.902353 Apr 23 03:50:58 user devstack@n-api.service[61308]: [pid: 61308|app: 0|req: 72/213] 10.0.0.210 () {66 vars in 1396 bytes} [Sun Apr 23 03:50:57 2023] POST /compute/v2.1/servers/c8480a7c-b5de-4f66-a4f0-08fc679b0dfd/action => generated 52 bytes in 904 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Apr 23 03:51:00 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi [None req-1899417e-0f4c-48ed-9b72-583bff20cd68 tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] Calling method '>' {{(pid=61306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 03:51:00 user devstack@n-api.service[61306]: DEBUG nova.compute.api [None req-1899417e-0f4c-48ed-9b72-583bff20cd68 tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] [instance: 6ee9a44e-e6af-4eec-975c-3991146ce71b] Fetching instance by UUID {{(pid=61306) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 23 03:51:00 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-1899417e-0f4c-48ed-9b72-583bff20cd68 tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:51:00 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-1899417e-0f4c-48ed-9b72-583bff20cd68 tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:51:00 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-1899417e-0f4c-48ed-9b72-583bff20cd68 tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:51:00 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-1899417e-0f4c-48ed-9b72-583bff20cd68 tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:51:00 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-1899417e-0f4c-48ed-9b72-583bff20cd68 tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:51:00 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-1899417e-0f4c-48ed-9b72-583bff20cd68 tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:51:01 user devstack@n-api.service[61306]: INFO nova.api.openstack.requestlog [None req-1899417e-0f4c-48ed-9b72-583bff20cd68 tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6ee9a44e-e6af-4eec-975c-3991146ce71b/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.364127 Apr 23 03:51:01 user devstack@n-api.service[61306]: [pid: 61306|app: 0|req: 71/214] 10.0.0.210 () {62 vars in 1352 bytes} [Sun Apr 23 03:51:00 2023] GET /compute/v2.1/servers/6ee9a44e-e6af-4eec-975c-3991146ce71b/os-interface => generated 283 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 23 03:51:01 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi [req-bcef500c-c183-48f1-ac94-c14cb0e1bbf9 req-823e9526-3837-4a65-b1d6-9b1b45b4271a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ee9a44e-e6af-4eec-975c-3991146ce71b", "tag": "aaf8a702-e47a-4fc7-a9a8-3a7e63525294"}]} {{(pid=61307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 03:51:01 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [req-bcef500c-c183-48f1-ac94-c14cb0e1bbf9 req-823e9526-3837-4a65-b1d6-9b1b45b4271a service nova] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:51:01 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [req-bcef500c-c183-48f1-ac94-c14cb0e1bbf9 req-823e9526-3837-4a65-b1d6-9b1b45b4271a service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:51:01 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [req-bcef500c-c183-48f1-ac94-c14cb0e1bbf9 req-823e9526-3837-4a65-b1d6-9b1b45b4271a service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:51:01 user devstack@n-api.service[61307]: INFO nova.api.openstack.compute.server_external_events [req-bcef500c-c183-48f1-ac94-c14cb0e1bbf9 req-823e9526-3837-4a65-b1d6-9b1b45b4271a service nova] Creating event network-changed:aaf8a702-e47a-4fc7-a9a8-3a7e63525294 for instance 6ee9a44e-e6af-4eec-975c-3991146ce71b on user Apr 23 03:51:01 user devstack@n-api.service[61307]: INFO nova.api.openstack.requestlog [req-bcef500c-c183-48f1-ac94-c14cb0e1bbf9 req-823e9526-3837-4a65-b1d6-9b1b45b4271a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031518 Apr 23 03:51:01 user devstack@n-api.service[61307]: [pid: 61307|app: 0|req: 72/215] 10.0.0.210 () {68 vars in 1394 bytes} [Sun Apr 23 03:51:01 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 23 03:51:02 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi [None req-83ac2253-b156-40c5-a935-ecf80f1e2e36 tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] Calling method '>' {{(pid=61308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 03:51:02 user devstack@n-api.service[61308]: DEBUG nova.compute.api [None req-83ac2253-b156-40c5-a935-ecf80f1e2e36 tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] [instance: 6ee9a44e-e6af-4eec-975c-3991146ce71b] Fetching instance by UUID {{(pid=61308) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 23 03:51:02 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-83ac2253-b156-40c5-a935-ecf80f1e2e36 tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:51:02 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-83ac2253-b156-40c5-a935-ecf80f1e2e36 tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:51:02 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-83ac2253-b156-40c5-a935-ecf80f1e2e36 tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:51:02 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-83ac2253-b156-40c5-a935-ecf80f1e2e36 tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:51:02 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-83ac2253-b156-40c5-a935-ecf80f1e2e36 tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:51:02 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-83ac2253-b156-40c5-a935-ecf80f1e2e36 tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:51:02 user devstack@n-api.service[61308]: INFO nova.api.openstack.requestlog [None req-83ac2253-b156-40c5-a935-ecf80f1e2e36 tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6ee9a44e-e6af-4eec-975c-3991146ce71b/ips" status: 200 len: 105 microversion: 2.1 time: 0.039938 Apr 23 03:51:02 user devstack@n-api.service[61308]: [pid: 61308|app: 0|req: 73/216] 10.0.0.210 () {62 vars in 1325 bytes} [Sun Apr 23 03:51:02 2023] GET /compute/v2.1/servers/6ee9a44e-e6af-4eec-975c-3991146ce71b/ips => generated 105 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 23 03:51:03 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi [None req-795e6b08-8d8c-4675-95f6-1196ad88bdac tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] Calling method '>' {{(pid=61306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 03:51:03 user devstack@n-api.service[61306]: DEBUG nova.compute.api [None req-795e6b08-8d8c-4675-95f6-1196ad88bdac tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] [instance: 6ee9a44e-e6af-4eec-975c-3991146ce71b] Fetching instance by UUID {{(pid=61306) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 23 03:51:03 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-795e6b08-8d8c-4675-95f6-1196ad88bdac tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:51:03 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-795e6b08-8d8c-4675-95f6-1196ad88bdac tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:51:03 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-795e6b08-8d8c-4675-95f6-1196ad88bdac tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:51:03 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-795e6b08-8d8c-4675-95f6-1196ad88bdac tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:51:03 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-795e6b08-8d8c-4675-95f6-1196ad88bdac tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:51:03 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-795e6b08-8d8c-4675-95f6-1196ad88bdac tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:51:03 user devstack@n-api.service[61306]: DEBUG nova.compute.api [None req-795e6b08-8d8c-4675-95f6-1196ad88bdac tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] [instance: 6ee9a44e-e6af-4eec-975c-3991146ce71b] Going to try to terminate instance {{(pid=61306) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 23 03:51:03 user devstack@n-api.service[61306]: INFO nova.api.openstack.requestlog [None req-795e6b08-8d8c-4675-95f6-1196ad88bdac tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/6ee9a44e-e6af-4eec-975c-3991146ce71b" status: 204 len: 0 microversion: 2.1 time: 0.114529 Apr 23 03:51:03 user devstack@n-api.service[61306]: [pid: 61306|app: 0|req: 72/217] 10.0.0.210 () {62 vars in 1316 bytes} [Sun Apr 23 03:51:03 2023] DELETE /compute/v2.1/servers/6ee9a44e-e6af-4eec-975c-3991146ce71b => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 23 03:51:03 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi [None req-4cbd1f2d-a5a7-4131-9c3b-76f18733c522 tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] Calling method '>' {{(pid=61307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 03:51:03 user devstack@n-api.service[61307]: DEBUG nova.compute.api [None req-4cbd1f2d-a5a7-4131-9c3b-76f18733c522 tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] [instance: 6ee9a44e-e6af-4eec-975c-3991146ce71b] Fetching instance by UUID {{(pid=61307) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 23 03:51:03 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-4cbd1f2d-a5a7-4131-9c3b-76f18733c522 tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:51:03 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-4cbd1f2d-a5a7-4131-9c3b-76f18733c522 tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:51:03 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-4cbd1f2d-a5a7-4131-9c3b-76f18733c522 tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:51:03 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-4cbd1f2d-a5a7-4131-9c3b-76f18733c522 tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:51:03 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-4cbd1f2d-a5a7-4131-9c3b-76f18733c522 tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:51:03 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-4cbd1f2d-a5a7-4131-9c3b-76f18733c522 tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:51:03 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi [req-b3c12500-5d16-4694-8521-4466545cc460 req-2ffd29c7-471e-4063-8616-c9ea6fca7a8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ee9a44e-e6af-4eec-975c-3991146ce71b", "name": "network-vif-unplugged", "status": "completed", "tag": "aaf8a702-e47a-4fc7-a9a8-3a7e63525294"}]} {{(pid=61308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 03:51:03 user devstack@n-api.service[61307]: DEBUG nova.policy [None req-4cbd1f2d-a5a7-4131-9c3b-76f18733c522 tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d689f1c160478ca83bbff3104d8ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b031ddc5c94ca98e7161de03bda4b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61307) authorize /opt/stack/nova/nova/policy.py:203}} Apr 23 03:51:03 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [req-b3c12500-5d16-4694-8521-4466545cc460 req-2ffd29c7-471e-4063-8616-c9ea6fca7a8d service nova] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:51:03 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [req-b3c12500-5d16-4694-8521-4466545cc460 req-2ffd29c7-471e-4063-8616-c9ea6fca7a8d service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:51:03 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [req-b3c12500-5d16-4694-8521-4466545cc460 req-2ffd29c7-471e-4063-8616-c9ea6fca7a8d service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:51:03 user devstack@n-api.service[61307]: INFO nova.api.openstack.requestlog [None req-4cbd1f2d-a5a7-4131-9c3b-76f18733c522 tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6ee9a44e-e6af-4eec-975c-3991146ce71b" status: 200 len: 1660 microversion: 2.1 time: 0.272329 Apr 23 03:51:03 user devstack@n-api.service[61307]: [pid: 61307|app: 0|req: 73/218] 10.0.0.210 () {62 vars in 1313 bytes} [Sun Apr 23 03:51:03 2023] GET /compute/v2.1/servers/6ee9a44e-e6af-4eec-975c-3991146ce71b => generated 1660 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 23 03:51:03 user devstack@n-api.service[61308]: INFO nova.api.openstack.compute.server_external_events [req-b3c12500-5d16-4694-8521-4466545cc460 req-2ffd29c7-471e-4063-8616-c9ea6fca7a8d service nova] Creating event network-vif-unplugged:aaf8a702-e47a-4fc7-a9a8-3a7e63525294 for instance 6ee9a44e-e6af-4eec-975c-3991146ce71b on user Apr 23 03:51:03 user devstack@n-api.service[61308]: INFO nova.api.openstack.requestlog [req-b3c12500-5d16-4694-8521-4466545cc460 req-2ffd29c7-471e-4063-8616-c9ea6fca7a8d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032691 Apr 23 03:51:03 user devstack@n-api.service[61308]: [pid: 61308|app: 0|req: 74/219] 10.0.0.210 () {68 vars in 1394 bytes} [Sun Apr 23 03:51:03 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 23 03:51:05 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi [req-063b1c65-d56b-438d-b8d3-0476782664f6 req-a99ccd16-7bf0-4d5e-bfa9-04dfd90616e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ee9a44e-e6af-4eec-975c-3991146ce71b", "name": "network-vif-deleted", "tag": "aaf8a702-e47a-4fc7-a9a8-3a7e63525294"}]} {{(pid=61306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 03:51:05 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [req-063b1c65-d56b-438d-b8d3-0476782664f6 req-a99ccd16-7bf0-4d5e-bfa9-04dfd90616e5 service nova] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:51:05 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [req-063b1c65-d56b-438d-b8d3-0476782664f6 req-a99ccd16-7bf0-4d5e-bfa9-04dfd90616e5 service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:51:05 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [req-063b1c65-d56b-438d-b8d3-0476782664f6 req-a99ccd16-7bf0-4d5e-bfa9-04dfd90616e5 service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:51:05 user devstack@n-api.service[61306]: INFO nova.api.openstack.compute.server_external_events [req-063b1c65-d56b-438d-b8d3-0476782664f6 req-a99ccd16-7bf0-4d5e-bfa9-04dfd90616e5 service nova] Creating event network-vif-deleted:aaf8a702-e47a-4fc7-a9a8-3a7e63525294 for instance 6ee9a44e-e6af-4eec-975c-3991146ce71b on user Apr 23 03:51:05 user devstack@n-api.service[61306]: INFO nova.api.openstack.requestlog [req-063b1c65-d56b-438d-b8d3-0476782664f6 req-a99ccd16-7bf0-4d5e-bfa9-04dfd90616e5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029777 Apr 23 03:51:05 user devstack@n-api.service[61306]: [pid: 61306|app: 0|req: 73/220] 10.0.0.210 () {68 vars in 1394 bytes} [Sun Apr 23 03:51:05 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 23 03:51:05 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi [None req-c979d144-23c5-451a-881a-d32092c3cdc0 tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Calling method '>' {{(pid=61307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 03:51:05 user devstack@n-api.service[61307]: DEBUG nova.compute.api [None req-c979d144-23c5-451a-881a-d32092c3cdc0 tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] [instance: c8480a7c-b5de-4f66-a4f0-08fc679b0dfd] Fetching instance by UUID {{(pid=61307) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 23 03:51:05 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-c979d144-23c5-451a-881a-d32092c3cdc0 tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:51:05 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-c979d144-23c5-451a-881a-d32092c3cdc0 tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:51:05 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-c979d144-23c5-451a-881a-d32092c3cdc0 tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:51:05 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-c979d144-23c5-451a-881a-d32092c3cdc0 tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:51:05 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-c979d144-23c5-451a-881a-d32092c3cdc0 tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:51:05 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-c979d144-23c5-451a-881a-d32092c3cdc0 tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:51:05 user devstack@n-api.service[61307]: DEBUG nova.policy [None req-c979d144-23c5-451a-881a-d32092c3cdc0 tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99495726467944c38620831fc93e2856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79e09b1c4ae4cc5ab11c3e56ee4f0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61307) authorize /opt/stack/nova/nova/policy.py:203}} Apr 23 03:51:05 user devstack@n-api.service[61307]: DEBUG nova.policy [None req-c979d144-23c5-451a-881a-d32092c3cdc0 tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99495726467944c38620831fc93e2856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79e09b1c4ae4cc5ab11c3e56ee4f0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61307) authorize /opt/stack/nova/nova/policy.py:203}} Apr 23 03:51:05 user devstack@n-api.service[61307]: DEBUG nova.policy [None req-c979d144-23c5-451a-881a-d32092c3cdc0 tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99495726467944c38620831fc93e2856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79e09b1c4ae4cc5ab11c3e56ee4f0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61307) authorize /opt/stack/nova/nova/policy.py:203}} Apr 23 03:51:05 user devstack@n-api.service[61307]: INFO nova.api.openstack.requestlog [None req-c979d144-23c5-451a-881a-d32092c3cdc0 tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c8480a7c-b5de-4f66-a4f0-08fc679b0dfd" status: 200 len: 1691 microversion: 2.87 time: 0.315592 Apr 23 03:51:05 user devstack@n-api.service[61307]: [pid: 61307|app: 0|req: 74/221] 10.0.0.210 () {64 vars in 1354 bytes} [Sun Apr 23 03:51:05 2023] GET /compute/v2.1/servers/c8480a7c-b5de-4f66-a4f0-08fc679b0dfd => generated 1691 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 23 03:51:05 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi [req-3c11e641-063c-47e0-8477-e1daaf312f02 req-56fb81c9-0122-4d35-abdb-484c3413d397 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ee9a44e-e6af-4eec-975c-3991146ce71b", "name": "network-vif-plugged", "status": "completed", "tag": "aaf8a702-e47a-4fc7-a9a8-3a7e63525294"}]} {{(pid=61308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 03:51:05 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [req-3c11e641-063c-47e0-8477-e1daaf312f02 req-56fb81c9-0122-4d35-abdb-484c3413d397 service nova] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:51:05 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [req-3c11e641-063c-47e0-8477-e1daaf312f02 req-56fb81c9-0122-4d35-abdb-484c3413d397 service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:51:05 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [req-3c11e641-063c-47e0-8477-e1daaf312f02 req-56fb81c9-0122-4d35-abdb-484c3413d397 service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:51:05 user devstack@n-api.service[61308]: INFO nova.api.openstack.compute.server_external_events [req-3c11e641-063c-47e0-8477-e1daaf312f02 req-56fb81c9-0122-4d35-abdb-484c3413d397 service nova] Creating event network-vif-plugged:aaf8a702-e47a-4fc7-a9a8-3a7e63525294 for instance 6ee9a44e-e6af-4eec-975c-3991146ce71b on user Apr 23 03:51:05 user devstack@n-api.service[61308]: INFO nova.api.openstack.requestlog [req-3c11e641-063c-47e0-8477-e1daaf312f02 req-56fb81c9-0122-4d35-abdb-484c3413d397 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028528 Apr 23 03:51:05 user devstack@n-api.service[61308]: [pid: 61308|app: 0|req: 75/222] 10.0.0.210 () {68 vars in 1394 bytes} [Sun Apr 23 03:51:05 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 23 03:51:10 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi [None req-6ba214cf-e85a-4b47-a6fd-39f3627fc565 tempest-VolumesAdminNegativeTest-594073230 tempest-VolumesAdminNegativeTest-594073230-project-member] Calling method '>' {{(pid=61306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 03:51:10 user devstack@n-api.service[61306]: DEBUG nova.compute.api [None req-6ba214cf-e85a-4b47-a6fd-39f3627fc565 tempest-VolumesAdminNegativeTest-594073230 tempest-VolumesAdminNegativeTest-594073230-project-member] [instance: 1d5ec75f-29f2-45c3-8d6e-74d9ec8b2f86] Fetching instance by UUID {{(pid=61306) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 23 03:51:10 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-6ba214cf-e85a-4b47-a6fd-39f3627fc565 tempest-VolumesAdminNegativeTest-594073230 tempest-VolumesAdminNegativeTest-594073230-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:51:10 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-6ba214cf-e85a-4b47-a6fd-39f3627fc565 tempest-VolumesAdminNegativeTest-594073230 tempest-VolumesAdminNegativeTest-594073230-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:51:10 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-6ba214cf-e85a-4b47-a6fd-39f3627fc565 tempest-VolumesAdminNegativeTest-594073230 tempest-VolumesAdminNegativeTest-594073230-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:51:10 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-6ba214cf-e85a-4b47-a6fd-39f3627fc565 tempest-VolumesAdminNegativeTest-594073230 tempest-VolumesAdminNegativeTest-594073230-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:51:10 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-6ba214cf-e85a-4b47-a6fd-39f3627fc565 tempest-VolumesAdminNegativeTest-594073230 tempest-VolumesAdminNegativeTest-594073230-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:51:10 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-6ba214cf-e85a-4b47-a6fd-39f3627fc565 tempest-VolumesAdminNegativeTest-594073230 tempest-VolumesAdminNegativeTest-594073230-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:51:10 user devstack@n-api.service[61306]: DEBUG nova.compute.api [None req-6ba214cf-e85a-4b47-a6fd-39f3627fc565 tempest-VolumesAdminNegativeTest-594073230 tempest-VolumesAdminNegativeTest-594073230-project-member] [instance: 1d5ec75f-29f2-45c3-8d6e-74d9ec8b2f86] Going to try to terminate instance {{(pid=61306) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 23 03:51:10 user devstack@n-api.service[61306]: INFO nova.api.openstack.requestlog [None req-6ba214cf-e85a-4b47-a6fd-39f3627fc565 tempest-VolumesAdminNegativeTest-594073230 tempest-VolumesAdminNegativeTest-594073230-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/1d5ec75f-29f2-45c3-8d6e-74d9ec8b2f86" status: 204 len: 0 microversion: 2.1 time: 0.124296 Apr 23 03:51:10 user devstack@n-api.service[61306]: [pid: 61306|app: 0|req: 74/223] 10.0.0.210 () {62 vars in 1316 bytes} [Sun Apr 23 03:51:10 2023] DELETE /compute/v2.1/servers/1d5ec75f-29f2-45c3-8d6e-74d9ec8b2f86 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 23 03:51:10 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi [None req-8883819e-2963-4df2-a6a5-297eb8c21769 tempest-VolumesAdminNegativeTest-594073230 tempest-VolumesAdminNegativeTest-594073230-project-member] Calling method '>' {{(pid=61307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 03:51:10 user devstack@n-api.service[61307]: DEBUG nova.compute.api [None req-8883819e-2963-4df2-a6a5-297eb8c21769 tempest-VolumesAdminNegativeTest-594073230 tempest-VolumesAdminNegativeTest-594073230-project-member] [instance: 1d5ec75f-29f2-45c3-8d6e-74d9ec8b2f86] Fetching instance by UUID {{(pid=61307) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 23 03:51:10 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-8883819e-2963-4df2-a6a5-297eb8c21769 tempest-VolumesAdminNegativeTest-594073230 tempest-VolumesAdminNegativeTest-594073230-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:51:10 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-8883819e-2963-4df2-a6a5-297eb8c21769 tempest-VolumesAdminNegativeTest-594073230 tempest-VolumesAdminNegativeTest-594073230-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:51:10 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-8883819e-2963-4df2-a6a5-297eb8c21769 tempest-VolumesAdminNegativeTest-594073230 tempest-VolumesAdminNegativeTest-594073230-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:51:10 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-8883819e-2963-4df2-a6a5-297eb8c21769 tempest-VolumesAdminNegativeTest-594073230 tempest-VolumesAdminNegativeTest-594073230-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:51:10 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-8883819e-2963-4df2-a6a5-297eb8c21769 tempest-VolumesAdminNegativeTest-594073230 tempest-VolumesAdminNegativeTest-594073230-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:51:10 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-8883819e-2963-4df2-a6a5-297eb8c21769 tempest-VolumesAdminNegativeTest-594073230 tempest-VolumesAdminNegativeTest-594073230-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:51:11 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi [req-c0a88ff6-3bf9-4c54-9732-2cf09374de31 req-e1c9ad1d-1f94-46ae-b73c-7a95f9767245 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d5ec75f-29f2-45c3-8d6e-74d9ec8b2f86", "name": "network-vif-unplugged", "status": "completed", "tag": "dbcb6234-6b80-49f9-b7a1-0f339da7084a"}]} {{(pid=61308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 03:51:11 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [req-c0a88ff6-3bf9-4c54-9732-2cf09374de31 req-e1c9ad1d-1f94-46ae-b73c-7a95f9767245 service nova] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:51:11 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [req-c0a88ff6-3bf9-4c54-9732-2cf09374de31 req-e1c9ad1d-1f94-46ae-b73c-7a95f9767245 service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:51:11 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [req-c0a88ff6-3bf9-4c54-9732-2cf09374de31 req-e1c9ad1d-1f94-46ae-b73c-7a95f9767245 service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:51:11 user devstack@n-api.service[61308]: INFO nova.api.openstack.compute.server_external_events [req-c0a88ff6-3bf9-4c54-9732-2cf09374de31 req-e1c9ad1d-1f94-46ae-b73c-7a95f9767245 service nova] Creating event network-vif-unplugged:dbcb6234-6b80-49f9-b7a1-0f339da7084a for instance 1d5ec75f-29f2-45c3-8d6e-74d9ec8b2f86 on user Apr 23 03:51:11 user devstack@n-api.service[61308]: INFO nova.api.openstack.requestlog [req-c0a88ff6-3bf9-4c54-9732-2cf09374de31 req-e1c9ad1d-1f94-46ae-b73c-7a95f9767245 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031480 Apr 23 03:51:11 user devstack@n-api.service[61308]: [pid: 61308|app: 0|req: 76/224] 10.0.0.210 () {68 vars in 1394 bytes} [Sun Apr 23 03:51:11 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 23 03:51:11 user devstack@n-api.service[61307]: DEBUG nova.policy [None req-8883819e-2963-4df2-a6a5-297eb8c21769 tempest-VolumesAdminNegativeTest-594073230 tempest-VolumesAdminNegativeTest-594073230-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e80c354abd34bd3a28ddaeec9535af2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb0a03655cf4aa78e27c81ea4e1c424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61307) authorize /opt/stack/nova/nova/policy.py:203}} Apr 23 03:51:11 user devstack@n-api.service[61307]: INFO nova.api.openstack.requestlog [None req-8883819e-2963-4df2-a6a5-297eb8c21769 tempest-VolumesAdminNegativeTest-594073230 tempest-VolumesAdminNegativeTest-594073230-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1d5ec75f-29f2-45c3-8d6e-74d9ec8b2f86" status: 200 len: 1502 microversion: 2.1 time: 0.250500 Apr 23 03:51:11 user devstack@n-api.service[61307]: [pid: 61307|app: 0|req: 75/225] 10.0.0.210 () {62 vars in 1313 bytes} [Sun Apr 23 03:51:10 2023] GET /compute/v2.1/servers/1d5ec75f-29f2-45c3-8d6e-74d9ec8b2f86 => generated 1502 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 23 03:51:11 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi [None req-d394fae7-6158-49c7-9847-a24b5f284290 tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] Calling method '>' {{(pid=61306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 03:51:11 user devstack@n-api.service[61306]: DEBUG nova.compute.api [None req-d394fae7-6158-49c7-9847-a24b5f284290 tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] [instance: 90cce4ec-f48c-408f-8d8f-46414bde01df] Fetching instance by UUID {{(pid=61306) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 23 03:51:11 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-d394fae7-6158-49c7-9847-a24b5f284290 tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:51:11 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-d394fae7-6158-49c7-9847-a24b5f284290 tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:51:11 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-d394fae7-6158-49c7-9847-a24b5f284290 tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:51:11 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-d394fae7-6158-49c7-9847-a24b5f284290 tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:51:11 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-d394fae7-6158-49c7-9847-a24b5f284290 tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:51:11 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-d394fae7-6158-49c7-9847-a24b5f284290 tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:51:11 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi [None req-a1f06e2c-7008-4328-9b27-b51a7709f661 tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] Calling method '>' {{(pid=61308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 03:51:11 user devstack@n-api.service[61308]: DEBUG nova.compute.api [None req-a1f06e2c-7008-4328-9b27-b51a7709f661 tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] [instance: 954f41b2-5c67-41a4-b38b-ebf3ad60cac7] Fetching instance by UUID {{(pid=61308) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 23 03:51:11 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-a1f06e2c-7008-4328-9b27-b51a7709f661 tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:51:11 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-a1f06e2c-7008-4328-9b27-b51a7709f661 tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:51:11 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-a1f06e2c-7008-4328-9b27-b51a7709f661 tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:51:11 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-a1f06e2c-7008-4328-9b27-b51a7709f661 tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:51:11 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-a1f06e2c-7008-4328-9b27-b51a7709f661 tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:51:11 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-a1f06e2c-7008-4328-9b27-b51a7709f661 tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:51:11 user devstack@n-api.service[61306]: DEBUG nova.policy [None req-d394fae7-6158-49c7-9847-a24b5f284290 tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93a8dbfd8cef4578aff742813ffe901e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab0f01751954d04a83b360b2f839716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61306) authorize /opt/stack/nova/nova/policy.py:203}} Apr 23 03:51:11 user devstack@n-api.service[61306]: INFO nova.api.openstack.requestlog [None req-d394fae7-6158-49c7-9847-a24b5f284290 tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] 10.0.0.210 "GET /compute/v2.1/servers/90cce4ec-f48c-408f-8d8f-46414bde01df" status: 200 len: 1535 microversion: 2.1 time: 0.266824 Apr 23 03:51:11 user devstack@n-api.service[61306]: [pid: 61306|app: 0|req: 75/226] 10.0.0.210 () {62 vars in 1313 bytes} [Sun Apr 23 03:51:11 2023] GET /compute/v2.1/servers/90cce4ec-f48c-408f-8d8f-46414bde01df => generated 1535 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 23 03:51:12 user devstack@n-api.service[61308]: DEBUG nova.policy [None req-a1f06e2c-7008-4328-9b27-b51a7709f661 tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdc8fe94058c46c28d4b3f16dc1e77ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f44fe9ba07e4e2f925d1a8952356e04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61308) authorize /opt/stack/nova/nova/policy.py:203}} Apr 23 03:51:12 user devstack@n-api.service[61308]: INFO nova.api.openstack.requestlog [None req-a1f06e2c-7008-4328-9b27-b51a7709f661 tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] 10.0.0.210 "GET /compute/v2.1/servers/954f41b2-5c67-41a4-b38b-ebf3ad60cac7" status: 200 len: 1658 microversion: 2.1 time: 0.279197 Apr 23 03:51:12 user devstack@n-api.service[61308]: [pid: 61308|app: 0|req: 77/227] 10.0.0.210 () {62 vars in 1313 bytes} [Sun Apr 23 03:51:11 2023] GET /compute/v2.1/servers/954f41b2-5c67-41a4-b38b-ebf3ad60cac7 => generated 1658 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 23 03:51:12 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi [None req-656799f4-2412-42ee-aa13-32534b892890 tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] Calling method '>' {{(pid=61307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 03:51:12 user devstack@n-api.service[61307]: DEBUG nova.compute.api [None req-656799f4-2412-42ee-aa13-32534b892890 tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] [instance: 954f41b2-5c67-41a4-b38b-ebf3ad60cac7] Fetching instance by UUID {{(pid=61307) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 23 03:51:12 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-656799f4-2412-42ee-aa13-32534b892890 tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:51:12 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-656799f4-2412-42ee-aa13-32534b892890 tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:51:12 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-656799f4-2412-42ee-aa13-32534b892890 tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:51:12 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-656799f4-2412-42ee-aa13-32534b892890 tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:51:12 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-656799f4-2412-42ee-aa13-32534b892890 tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:51:12 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-656799f4-2412-42ee-aa13-32534b892890 tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:51:12 user devstack@n-api.service[61307]: DEBUG nova.policy [None req-656799f4-2412-42ee-aa13-32534b892890 tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdc8fe94058c46c28d4b3f16dc1e77ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f44fe9ba07e4e2f925d1a8952356e04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61307) authorize /opt/stack/nova/nova/policy.py:203}} Apr 23 03:51:12 user devstack@n-api.service[61307]: INFO nova.api.openstack.requestlog [None req-656799f4-2412-42ee-aa13-32534b892890 tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] 10.0.0.210 "GET /compute/v2.1/servers/954f41b2-5c67-41a4-b38b-ebf3ad60cac7" status: 200 len: 1658 microversion: 2.1 time: 0.152604 Apr 23 03:51:12 user devstack@n-api.service[61307]: [pid: 61307|app: 0|req: 76/228] 10.0.0.210 () {62 vars in 1313 bytes} [Sun Apr 23 03:51:12 2023] GET /compute/v2.1/servers/954f41b2-5c67-41a4-b38b-ebf3ad60cac7 => generated 1658 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 23 03:51:12 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi [None req-7e94c273-93e4-4cb1-9e1f-6a8ef0137707 tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] Calling method '>' {{(pid=61306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 03:51:12 user devstack@n-api.service[61306]: DEBUG nova.compute.api [None req-7e94c273-93e4-4cb1-9e1f-6a8ef0137707 tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] [instance: 954f41b2-5c67-41a4-b38b-ebf3ad60cac7] Fetching instance by UUID {{(pid=61306) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 23 03:51:12 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-7e94c273-93e4-4cb1-9e1f-6a8ef0137707 tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:51:12 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-7e94c273-93e4-4cb1-9e1f-6a8ef0137707 tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:51:12 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-7e94c273-93e4-4cb1-9e1f-6a8ef0137707 tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:51:12 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-7e94c273-93e4-4cb1-9e1f-6a8ef0137707 tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:51:12 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi [req-94e8d73a-7985-474c-b848-d1e250a21311 req-f3ce1ffa-c36c-4e43-b140-dc4f3d58ec32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d5ec75f-29f2-45c3-8d6e-74d9ec8b2f86", "name": "network-vif-deleted", "tag": "dbcb6234-6b80-49f9-b7a1-0f339da7084a"}]} {{(pid=61308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 03:51:12 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-7e94c273-93e4-4cb1-9e1f-6a8ef0137707 tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:51:12 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-7e94c273-93e4-4cb1-9e1f-6a8ef0137707 tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:51:12 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [req-94e8d73a-7985-474c-b848-d1e250a21311 req-f3ce1ffa-c36c-4e43-b140-dc4f3d58ec32 service nova] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:51:12 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [req-94e8d73a-7985-474c-b848-d1e250a21311 req-f3ce1ffa-c36c-4e43-b140-dc4f3d58ec32 service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:51:12 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [req-94e8d73a-7985-474c-b848-d1e250a21311 req-f3ce1ffa-c36c-4e43-b140-dc4f3d58ec32 service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:51:12 user devstack@n-api.service[61308]: INFO nova.api.openstack.compute.server_external_events [req-94e8d73a-7985-474c-b848-d1e250a21311 req-f3ce1ffa-c36c-4e43-b140-dc4f3d58ec32 service nova] Creating event network-vif-deleted:dbcb6234-6b80-49f9-b7a1-0f339da7084a for instance 1d5ec75f-29f2-45c3-8d6e-74d9ec8b2f86 on user Apr 23 03:51:12 user devstack@n-api.service[61308]: INFO nova.api.openstack.requestlog [req-94e8d73a-7985-474c-b848-d1e250a21311 req-f3ce1ffa-c36c-4e43-b140-dc4f3d58ec32 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029923 Apr 23 03:51:12 user devstack@n-api.service[61308]: [pid: 61308|app: 0|req: 78/229] 10.0.0.210 () {68 vars in 1394 bytes} [Sun Apr 23 03:51:12 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 23 03:51:12 user devstack@n-api.service[61306]: DEBUG nova.policy [None req-7e94c273-93e4-4cb1-9e1f-6a8ef0137707 tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdc8fe94058c46c28d4b3f16dc1e77ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f44fe9ba07e4e2f925d1a8952356e04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61306) authorize /opt/stack/nova/nova/policy.py:203}} Apr 23 03:51:12 user devstack@n-api.service[61306]: INFO nova.api.openstack.requestlog [None req-7e94c273-93e4-4cb1-9e1f-6a8ef0137707 tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] 10.0.0.210 "GET /compute/v2.1/servers/954f41b2-5c67-41a4-b38b-ebf3ad60cac7" status: 200 len: 1658 microversion: 2.1 time: 0.217126 Apr 23 03:51:12 user devstack@n-api.service[61306]: [pid: 61306|app: 0|req: 76/230] 10.0.0.210 () {62 vars in 1313 bytes} [Sun Apr 23 03:51:12 2023] GET /compute/v2.1/servers/954f41b2-5c67-41a4-b38b-ebf3ad60cac7 => generated 1658 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 23 03:51:13 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi [req-ea622c0c-4729-4abd-89da-1e36ee90052a req-51d25521-78a6-4dda-acd5-56807db41757 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d5ec75f-29f2-45c3-8d6e-74d9ec8b2f86", "name": "network-vif-plugged", "status": "completed", "tag": "dbcb6234-6b80-49f9-b7a1-0f339da7084a"}]} {{(pid=61307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 03:51:13 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [req-ea622c0c-4729-4abd-89da-1e36ee90052a req-51d25521-78a6-4dda-acd5-56807db41757 service nova] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:51:13 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [req-ea622c0c-4729-4abd-89da-1e36ee90052a req-51d25521-78a6-4dda-acd5-56807db41757 service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:51:13 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [req-ea622c0c-4729-4abd-89da-1e36ee90052a req-51d25521-78a6-4dda-acd5-56807db41757 service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:51:13 user devstack@n-api.service[61307]: INFO nova.api.openstack.compute.server_external_events [req-ea622c0c-4729-4abd-89da-1e36ee90052a req-51d25521-78a6-4dda-acd5-56807db41757 service nova] Creating event network-vif-plugged:dbcb6234-6b80-49f9-b7a1-0f339da7084a for instance 1d5ec75f-29f2-45c3-8d6e-74d9ec8b2f86 on user Apr 23 03:51:13 user devstack@n-api.service[61307]: INFO nova.api.openstack.requestlog [req-ea622c0c-4729-4abd-89da-1e36ee90052a req-51d25521-78a6-4dda-acd5-56807db41757 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029502 Apr 23 03:51:13 user devstack@n-api.service[61307]: [pid: 61307|app: 0|req: 77/231] 10.0.0.210 () {68 vars in 1394 bytes} [Sun Apr 23 03:51:13 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 23 03:51:53 user devstack@n-api.service[61308]: DEBUG dbcounter [-] [61308] Writing DB stats nova_api:SELECT=16 {{(pid=61308) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:51:53 user devstack@n-api.service[61308]: DEBUG dbcounter [-] [61308] Writing DB stats nova_cell1:SELECT=33,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61308) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:51:54 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi [None req-236d4cd8-404e-4a77-88a9-85748bd42066 tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] Calling method '>' {{(pid=61308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 03:51:54 user devstack@n-api.service[61308]: DEBUG nova.compute.api [None req-236d4cd8-404e-4a77-88a9-85748bd42066 tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] [instance: 6ee9a44e-e6af-4eec-975c-3991146ce71b] Fetching instance by UUID {{(pid=61308) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 23 03:51:54 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-236d4cd8-404e-4a77-88a9-85748bd42066 tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:51:54 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-236d4cd8-404e-4a77-88a9-85748bd42066 tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:51:54 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-236d4cd8-404e-4a77-88a9-85748bd42066 tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:51:54 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-236d4cd8-404e-4a77-88a9-85748bd42066 tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:51:54 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-236d4cd8-404e-4a77-88a9-85748bd42066 tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:51:54 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-236d4cd8-404e-4a77-88a9-85748bd42066 tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:51:54 user devstack@n-api.service[61308]: INFO nova.api.openstack.wsgi [None req-236d4cd8-404e-4a77-88a9-85748bd42066 tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] HTTP exception thrown: Instance 6ee9a44e-e6af-4eec-975c-3991146ce71b could not be found. Apr 23 03:51:54 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi [None req-236d4cd8-404e-4a77-88a9-85748bd42066 tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] Request method failure captured: Apr 23 03:51:54 user devstack@n-api.service[61308]: request: GET /compute/v2.1/servers/6ee9a44e-e6af-4eec-975c-3991146ce71b HTTP/1.1 Apr 23 03:51:54 user devstack@n-api.service[61308]: Accept: application/json Apr 23 03:51:54 user devstack@n-api.service[61308]: Accept-Encoding: identity Apr 23 03:51:54 user devstack@n-api.service[61308]: Connection: close Apr 23 03:51:54 user devstack@n-api.service[61308]: Content-Length: 0 Apr 23 03:51:54 user devstack@n-api.service[61308]: Content-Type: application/json Apr 23 03:51:54 user devstack@n-api.service[61308]: Host: 10.0.0.210 Apr 23 03:51:54 user devstack@n-api.service[61308]: Openstack-System-Scope: None Apr 23 03:51:54 user devstack@n-api.service[61308]: User-Agent: python-urllib3/1.26.15 Apr 23 03:51:54 user devstack@n-api.service[61308]: X-Auth-Token: gAAAAABkRKoEHslY58NoapplHv096IIemOcJ2uEL5fg5YnsrIN7vEVe0goC2-fhyT-4hwLklX7U-s1WIYv72E0xvN5TVTtH79X_fujgCXOgwUZcOoajDGkzv6NTcV4kTMtcgQuvKnfzUIN9o6o81Rg7rqi8gYyC-7qPK6BIPOMDOMMURsNRPwDw Apr 23 03:51:54 user devstack@n-api.service[61308]: X-Domain-Id: None Apr 23 03:51:54 user devstack@n-api.service[61308]: X-Domain-Name: None Apr 23 03:51:54 user devstack@n-api.service[61308]: X-Identity-Status: Confirmed Apr 23 03:51:54 user devstack@n-api.service[61308]: X-Is-Admin-Project: True Apr 23 03:51:54 user devstack@n-api.service[61308]: X-Project-Domain-Id: default Apr 23 03:51:54 user devstack@n-api.service[61308]: X-Project-Domain-Name: Default Apr 23 03:51:54 user devstack@n-api.service[61308]: X-Project-Id: 70b031ddc5c94ca98e7161de03bda4b7 Apr 23 03:51:54 user devstack@n-api.service[61308]: X-Project-Name: tempest-AttachVolumeTestJSON-276721084 Apr 23 03:51:54 user devstack@n-api.service[61308]: X-Role: reader,member Apr 23 03:51:54 user devstack@n-api.service[61308]: X-Roles: reader,member Apr 23 03:51:54 user devstack@n-api.service[61308]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/70b031ddc5c94ca98e7161de03bda4b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/70b031ddc5c94ca98e7161de03bda4b7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/70b031ddc5c94ca98e7161de03bda4b7"}]}] Apr 23 03:51:54 user devstack@n-api.service[61308]: X-Tenant: tempest-AttachVolumeTestJSON-276721084 Apr 23 03:51:54 user devstack@n-api.service[61308]: X-Tenant-Id: 70b031ddc5c94ca98e7161de03bda4b7 Apr 23 03:51:54 user devstack@n-api.service[61308]: X-Tenant-Name: tempest-AttachVolumeTestJSON-276721084 Apr 23 03:51:54 user devstack@n-api.service[61308]: X-User: tempest-AttachVolumeTestJSON-276721084-project-member Apr 23 03:51:54 user devstack@n-api.service[61308]: X-User-Domain-Id: default Apr 23 03:51:54 user devstack@n-api.service[61308]: X-User-Domain-Name: Default Apr 23 03:51:54 user devstack@n-api.service[61308]: X-User-Id: e3d689f1c160478ca83bbff3104d8ec3 Apr 23 03:51:54 user devstack@n-api.service[61308]: X-User-Name: tempest-AttachVolumeTestJSON-276721084-project-member Apr 23 03:51:54 user devstack@n-api.service[61308]: method: > Apr 23 03:51:54 user devstack@n-api.service[61308]: exception: Instance 6ee9a44e-e6af-4eec-975c-3991146ce71b could not be found. Apr 23 03:51:54 user devstack@n-api.service[61308]: action_args: {'id': '6ee9a44e-e6af-4eec-975c-3991146ce71b'} Apr 23 03:51:54 user devstack@n-api.service[61308]: {{(pid=61308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 23 03:51:54 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 23 03:51:54 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 23 03:51:54 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 23 03:51:54 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 23 03:51:54 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 23 03:51:54 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 23 03:51:54 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 23 03:51:54 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 23 03:51:54 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 23 03:51:54 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ee9a44e-e6af-4eec-975c-3991146ce71b could not be found. Apr 23 03:51:54 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi Apr 23 03:51:54 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 23 03:51:54 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi Apr 23 03:51:54 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 23 03:51:54 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 23 03:51:54 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 23 03:51:54 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 23 03:51:54 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 23 03:51:54 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 23 03:51:54 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 23 03:51:54 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 23 03:51:54 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 23 03:51:54 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 23 03:51:54 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 23 03:51:54 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 23 03:51:54 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 23 03:51:54 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ee9a44e-e6af-4eec-975c-3991146ce71b could not be found. Apr 23 03:51:54 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi Apr 23 03:51:54 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 23 03:51:54 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi Apr 23 03:51:54 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 23 03:51:54 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 23 03:51:54 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 23 03:51:54 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 23 03:51:54 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 23 03:51:54 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ee9a44e-e6af-4eec-975c-3991146ce71b could not be found. Apr 23 03:51:54 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi Apr 23 03:51:54 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi [None req-236d4cd8-404e-4a77-88a9-85748bd42066 tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] Returning 404 to user: Instance 6ee9a44e-e6af-4eec-975c-3991146ce71b could not be found. {{(pid=61308) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 23 03:51:54 user devstack@n-api.service[61308]: INFO nova.api.openstack.requestlog [None req-236d4cd8-404e-4a77-88a9-85748bd42066 tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6ee9a44e-e6af-4eec-975c-3991146ce71b" status: 404 len: 111 microversion: 2.1 time: 0.262800 Apr 23 03:51:54 user devstack@n-api.service[61308]: [pid: 61308|app: 0|req: 79/232] 10.0.0.210 () {62 vars in 1313 bytes} [Sun Apr 23 03:51:53 2023] GET /compute/v2.1/servers/6ee9a44e-e6af-4eec-975c-3991146ce71b => generated 111 bytes in 264 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 23 03:51:54 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi [None req-14007030-affc-4593-8294-70002b832a65 tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] Calling method '.version_select at 0x7f21e12b2170>' {{(pid=61306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 03:51:54 user devstack@n-api.service[61306]: DEBUG dbcounter [-] [61306] Writing DB stats nova_api:SELECT=25,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=61306) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:51:54 user devstack@n-api.service[61306]: DEBUG dbcounter [-] [61306] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61306) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:51:54 user devstack@n-api.service[61306]: INFO nova.api.openstack.requestlog [None req-14007030-affc-4593-8294-70002b832a65 tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1779422949" status: 202 len: 0 microversion: 2.1 time: 0.035848 Apr 23 03:51:54 user devstack@n-api.service[61306]: [pid: 61306|app: 0|req: 77/233] 10.0.0.210 () {62 vars in 1298 bytes} [Sun Apr 23 03:51:54 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1779422949 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 23 03:51:54 user devstack@n-api.service[61307]: DEBUG dbcounter [-] [61307] Writing DB stats nova_api:SELECT=16 {{(pid=61307) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:51:54 user devstack@n-api.service[61307]: DEBUG dbcounter [-] [61307] Writing DB stats nova_cell1:SELECT=34 {{(pid=61307) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:51:54 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi [None req-44802ce9-82a3-454b-a20f-f485aaa1337b tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] Calling method '>' {{(pid=61307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 03:51:54 user devstack@n-api.service[61307]: DEBUG nova.compute.api [None req-44802ce9-82a3-454b-a20f-f485aaa1337b tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] [instance: 6ee9a44e-e6af-4eec-975c-3991146ce71b] Fetching instance by UUID {{(pid=61307) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 23 03:51:54 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-44802ce9-82a3-454b-a20f-f485aaa1337b tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:51:54 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-44802ce9-82a3-454b-a20f-f485aaa1337b tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:51:54 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-44802ce9-82a3-454b-a20f-f485aaa1337b tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:51:54 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-44802ce9-82a3-454b-a20f-f485aaa1337b tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:51:54 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-44802ce9-82a3-454b-a20f-f485aaa1337b tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:51:54 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-44802ce9-82a3-454b-a20f-f485aaa1337b tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:51:54 user devstack@n-api.service[61307]: INFO nova.api.openstack.wsgi [None req-44802ce9-82a3-454b-a20f-f485aaa1337b tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] HTTP exception thrown: Instance 6ee9a44e-e6af-4eec-975c-3991146ce71b could not be found. Apr 23 03:51:54 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi [None req-44802ce9-82a3-454b-a20f-f485aaa1337b tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] Request method failure captured: Apr 23 03:51:54 user devstack@n-api.service[61307]: request: DELETE /compute/v2.1/servers/6ee9a44e-e6af-4eec-975c-3991146ce71b HTTP/1.1 Apr 23 03:51:54 user devstack@n-api.service[61307]: Accept: application/json Apr 23 03:51:54 user devstack@n-api.service[61307]: Accept-Encoding: identity Apr 23 03:51:54 user devstack@n-api.service[61307]: Connection: close Apr 23 03:51:54 user devstack@n-api.service[61307]: Content-Length: 0 Apr 23 03:51:54 user devstack@n-api.service[61307]: Content-Type: application/json Apr 23 03:51:54 user devstack@n-api.service[61307]: Host: 10.0.0.210 Apr 23 03:51:54 user devstack@n-api.service[61307]: Openstack-System-Scope: None Apr 23 03:51:54 user devstack@n-api.service[61307]: User-Agent: python-urllib3/1.26.15 Apr 23 03:51:54 user devstack@n-api.service[61307]: X-Auth-Token: gAAAAABkRKoEHslY58NoapplHv096IIemOcJ2uEL5fg5YnsrIN7vEVe0goC2-fhyT-4hwLklX7U-s1WIYv72E0xvN5TVTtH79X_fujgCXOgwUZcOoajDGkzv6NTcV4kTMtcgQuvKnfzUIN9o6o81Rg7rqi8gYyC-7qPK6BIPOMDOMMURsNRPwDw Apr 23 03:51:54 user devstack@n-api.service[61307]: X-Domain-Id: None Apr 23 03:51:54 user devstack@n-api.service[61307]: X-Domain-Name: None Apr 23 03:51:54 user devstack@n-api.service[61307]: X-Identity-Status: Confirmed Apr 23 03:51:54 user devstack@n-api.service[61307]: X-Is-Admin-Project: True Apr 23 03:51:54 user devstack@n-api.service[61307]: X-Project-Domain-Id: default Apr 23 03:51:54 user devstack@n-api.service[61307]: X-Project-Domain-Name: Default Apr 23 03:51:54 user devstack@n-api.service[61307]: X-Project-Id: 70b031ddc5c94ca98e7161de03bda4b7 Apr 23 03:51:54 user devstack@n-api.service[61307]: X-Project-Name: tempest-AttachVolumeTestJSON-276721084 Apr 23 03:51:54 user devstack@n-api.service[61307]: X-Role: reader,member Apr 23 03:51:54 user devstack@n-api.service[61307]: X-Roles: reader,member Apr 23 03:51:54 user devstack@n-api.service[61307]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/70b031ddc5c94ca98e7161de03bda4b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/70b031ddc5c94ca98e7161de03bda4b7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/70b031ddc5c94ca98e7161de03bda4b7"}]}] Apr 23 03:51:54 user devstack@n-api.service[61307]: X-Tenant: tempest-AttachVolumeTestJSON-276721084 Apr 23 03:51:54 user devstack@n-api.service[61307]: X-Tenant-Id: 70b031ddc5c94ca98e7161de03bda4b7 Apr 23 03:51:54 user devstack@n-api.service[61307]: X-Tenant-Name: tempest-AttachVolumeTestJSON-276721084 Apr 23 03:51:54 user devstack@n-api.service[61307]: X-User: tempest-AttachVolumeTestJSON-276721084-project-member Apr 23 03:51:54 user devstack@n-api.service[61307]: X-User-Domain-Id: default Apr 23 03:51:54 user devstack@n-api.service[61307]: X-User-Domain-Name: Default Apr 23 03:51:54 user devstack@n-api.service[61307]: X-User-Id: e3d689f1c160478ca83bbff3104d8ec3 Apr 23 03:51:54 user devstack@n-api.service[61307]: X-User-Name: tempest-AttachVolumeTestJSON-276721084-project-member Apr 23 03:51:54 user devstack@n-api.service[61307]: method: > Apr 23 03:51:54 user devstack@n-api.service[61307]: exception: Instance 6ee9a44e-e6af-4eec-975c-3991146ce71b could not be found. Apr 23 03:51:54 user devstack@n-api.service[61307]: action_args: {'id': '6ee9a44e-e6af-4eec-975c-3991146ce71b'} Apr 23 03:51:54 user devstack@n-api.service[61307]: {{(pid=61307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 23 03:51:54 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 23 03:51:54 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 23 03:51:54 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 23 03:51:54 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 23 03:51:54 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 23 03:51:54 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 23 03:51:54 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 23 03:51:54 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 23 03:51:54 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 23 03:51:54 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ee9a44e-e6af-4eec-975c-3991146ce71b could not be found. Apr 23 03:51:54 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi Apr 23 03:51:54 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 23 03:51:54 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi Apr 23 03:51:54 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 23 03:51:54 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 23 03:51:54 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 23 03:51:54 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 23 03:51:54 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 23 03:51:54 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 23 03:51:54 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 23 03:51:54 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 23 03:51:54 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 23 03:51:54 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 23 03:51:54 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 23 03:51:54 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 23 03:51:54 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 23 03:51:54 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 23 03:51:54 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 23 03:51:54 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ee9a44e-e6af-4eec-975c-3991146ce71b could not be found. Apr 23 03:51:54 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi Apr 23 03:51:54 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 23 03:51:54 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi Apr 23 03:51:54 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 23 03:51:54 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 23 03:51:54 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 23 03:51:54 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 23 03:51:54 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 23 03:51:54 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ee9a44e-e6af-4eec-975c-3991146ce71b could not be found. Apr 23 03:51:54 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi Apr 23 03:51:54 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi [None req-44802ce9-82a3-454b-a20f-f485aaa1337b tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] Returning 404 to user: Instance 6ee9a44e-e6af-4eec-975c-3991146ce71b could not be found. {{(pid=61307) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 23 03:51:54 user devstack@n-api.service[61307]: INFO nova.api.openstack.requestlog [None req-44802ce9-82a3-454b-a20f-f485aaa1337b tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/6ee9a44e-e6af-4eec-975c-3991146ce71b" status: 404 len: 111 microversion: 2.1 time: 0.038084 Apr 23 03:51:54 user devstack@n-api.service[61307]: [pid: 61307|app: 0|req: 78/234] 10.0.0.210 () {62 vars in 1316 bytes} [Sun Apr 23 03:51:54 2023] DELETE /compute/v2.1/servers/6ee9a44e-e6af-4eec-975c-3991146ce71b => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 23 03:51:54 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi [None req-d2750171-82ad-490a-8b74-deffca634012 tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] Calling method '>' {{(pid=61308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 03:51:54 user devstack@n-api.service[61308]: DEBUG nova.compute.api [None req-d2750171-82ad-490a-8b74-deffca634012 tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] [instance: 6ee9a44e-e6af-4eec-975c-3991146ce71b] Fetching instance by UUID {{(pid=61308) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 23 03:51:54 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-d2750171-82ad-490a-8b74-deffca634012 tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:51:54 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-d2750171-82ad-490a-8b74-deffca634012 tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:51:54 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-d2750171-82ad-490a-8b74-deffca634012 tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:51:54 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-d2750171-82ad-490a-8b74-deffca634012 tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:51:54 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-d2750171-82ad-490a-8b74-deffca634012 tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:51:54 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-d2750171-82ad-490a-8b74-deffca634012 tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:51:54 user devstack@n-api.service[61308]: INFO nova.api.openstack.wsgi [None req-d2750171-82ad-490a-8b74-deffca634012 tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] HTTP exception thrown: Instance 6ee9a44e-e6af-4eec-975c-3991146ce71b could not be found. Apr 23 03:51:54 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi [None req-d2750171-82ad-490a-8b74-deffca634012 tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] Request method failure captured: Apr 23 03:51:54 user devstack@n-api.service[61308]: request: GET /compute/v2.1/servers/6ee9a44e-e6af-4eec-975c-3991146ce71b HTTP/1.1 Apr 23 03:51:54 user devstack@n-api.service[61308]: Accept: application/json Apr 23 03:51:54 user devstack@n-api.service[61308]: Accept-Encoding: identity Apr 23 03:51:54 user devstack@n-api.service[61308]: Connection: close Apr 23 03:51:54 user devstack@n-api.service[61308]: Content-Length: 0 Apr 23 03:51:54 user devstack@n-api.service[61308]: Content-Type: application/json Apr 23 03:51:54 user devstack@n-api.service[61308]: Host: 10.0.0.210 Apr 23 03:51:54 user devstack@n-api.service[61308]: Openstack-System-Scope: None Apr 23 03:51:54 user devstack@n-api.service[61308]: User-Agent: python-urllib3/1.26.15 Apr 23 03:51:54 user devstack@n-api.service[61308]: X-Auth-Token: gAAAAABkRKoEHslY58NoapplHv096IIemOcJ2uEL5fg5YnsrIN7vEVe0goC2-fhyT-4hwLklX7U-s1WIYv72E0xvN5TVTtH79X_fujgCXOgwUZcOoajDGkzv6NTcV4kTMtcgQuvKnfzUIN9o6o81Rg7rqi8gYyC-7qPK6BIPOMDOMMURsNRPwDw Apr 23 03:51:54 user devstack@n-api.service[61308]: X-Domain-Id: None Apr 23 03:51:54 user devstack@n-api.service[61308]: X-Domain-Name: None Apr 23 03:51:54 user devstack@n-api.service[61308]: X-Identity-Status: Confirmed Apr 23 03:51:54 user devstack@n-api.service[61308]: X-Is-Admin-Project: True Apr 23 03:51:54 user devstack@n-api.service[61308]: X-Project-Domain-Id: default Apr 23 03:51:54 user devstack@n-api.service[61308]: X-Project-Domain-Name: Default Apr 23 03:51:54 user devstack@n-api.service[61308]: X-Project-Id: 70b031ddc5c94ca98e7161de03bda4b7 Apr 23 03:51:54 user devstack@n-api.service[61308]: X-Project-Name: tempest-AttachVolumeTestJSON-276721084 Apr 23 03:51:54 user devstack@n-api.service[61308]: X-Role: reader,member Apr 23 03:51:54 user devstack@n-api.service[61308]: X-Roles: reader,member Apr 23 03:51:54 user devstack@n-api.service[61308]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/70b031ddc5c94ca98e7161de03bda4b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/70b031ddc5c94ca98e7161de03bda4b7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/70b031ddc5c94ca98e7161de03bda4b7"}]}] Apr 23 03:51:54 user devstack@n-api.service[61308]: X-Tenant: tempest-AttachVolumeTestJSON-276721084 Apr 23 03:51:54 user devstack@n-api.service[61308]: X-Tenant-Id: 70b031ddc5c94ca98e7161de03bda4b7 Apr 23 03:51:54 user devstack@n-api.service[61308]: X-Tenant-Name: tempest-AttachVolumeTestJSON-276721084 Apr 23 03:51:54 user devstack@n-api.service[61308]: X-User: tempest-AttachVolumeTestJSON-276721084-project-member Apr 23 03:51:54 user devstack@n-api.service[61308]: X-User-Domain-Id: default Apr 23 03:51:54 user devstack@n-api.service[61308]: X-User-Domain-Name: Default Apr 23 03:51:54 user devstack@n-api.service[61308]: X-User-Id: e3d689f1c160478ca83bbff3104d8ec3 Apr 23 03:51:54 user devstack@n-api.service[61308]: X-User-Name: tempest-AttachVolumeTestJSON-276721084-project-member Apr 23 03:51:54 user devstack@n-api.service[61308]: method: > Apr 23 03:51:54 user devstack@n-api.service[61308]: exception: Instance 6ee9a44e-e6af-4eec-975c-3991146ce71b could not be found. Apr 23 03:51:54 user devstack@n-api.service[61308]: action_args: {'id': '6ee9a44e-e6af-4eec-975c-3991146ce71b'} Apr 23 03:51:54 user devstack@n-api.service[61308]: {{(pid=61308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 23 03:51:54 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 23 03:51:54 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 23 03:51:54 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 23 03:51:54 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 23 03:51:54 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 23 03:51:54 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 23 03:51:54 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 23 03:51:54 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 23 03:51:54 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 23 03:51:54 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ee9a44e-e6af-4eec-975c-3991146ce71b could not be found. Apr 23 03:51:54 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi Apr 23 03:51:54 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 23 03:51:54 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi Apr 23 03:51:54 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 23 03:51:54 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 23 03:51:54 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 23 03:51:54 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 23 03:51:54 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 23 03:51:54 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 23 03:51:54 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 23 03:51:54 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 23 03:51:54 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 23 03:51:54 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 23 03:51:54 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 23 03:51:54 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 23 03:51:54 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 23 03:51:54 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ee9a44e-e6af-4eec-975c-3991146ce71b could not be found. Apr 23 03:51:54 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi Apr 23 03:51:54 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 23 03:51:54 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi Apr 23 03:51:54 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 23 03:51:54 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 23 03:51:54 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 23 03:51:54 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 23 03:51:54 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 23 03:51:54 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ee9a44e-e6af-4eec-975c-3991146ce71b could not be found. Apr 23 03:51:54 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi Apr 23 03:51:54 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi [None req-d2750171-82ad-490a-8b74-deffca634012 tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] Returning 404 to user: Instance 6ee9a44e-e6af-4eec-975c-3991146ce71b could not be found. {{(pid=61308) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 23 03:51:54 user devstack@n-api.service[61308]: INFO nova.api.openstack.requestlog [None req-d2750171-82ad-490a-8b74-deffca634012 tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6ee9a44e-e6af-4eec-975c-3991146ce71b" status: 404 len: 111 microversion: 2.1 time: 0.028543 Apr 23 03:51:54 user devstack@n-api.service[61308]: [pid: 61308|app: 0|req: 80/235] 10.0.0.210 () {62 vars in 1313 bytes} [Sun Apr 23 03:51:54 2023] GET /compute/v2.1/servers/6ee9a44e-e6af-4eec-975c-3991146ce71b => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 23 03:51:55 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi [None req-14a8885f-bb9f-4f52-a361-00d2d5ba5c73 tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] Calling method '>' {{(pid=61306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 03:51:55 user devstack@n-api.service[61306]: DEBUG nova.compute.api [None req-14a8885f-bb9f-4f52-a361-00d2d5ba5c73 tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] [instance: 08d906c5-1698-4c17-8430-c98f10836398] Fetching instance by UUID {{(pid=61306) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 23 03:51:55 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-14a8885f-bb9f-4f52-a361-00d2d5ba5c73 tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:51:55 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-14a8885f-bb9f-4f52-a361-00d2d5ba5c73 tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:51:55 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-14a8885f-bb9f-4f52-a361-00d2d5ba5c73 tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:51:55 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-14a8885f-bb9f-4f52-a361-00d2d5ba5c73 tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:51:55 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-14a8885f-bb9f-4f52-a361-00d2d5ba5c73 tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:51:55 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-14a8885f-bb9f-4f52-a361-00d2d5ba5c73 tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:51:55 user devstack@n-api.service[61306]: INFO nova.api.openstack.wsgi [None req-14a8885f-bb9f-4f52-a361-00d2d5ba5c73 tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] HTTP exception thrown: Instance 08d906c5-1698-4c17-8430-c98f10836398 could not be found. Apr 23 03:51:55 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi [None req-14a8885f-bb9f-4f52-a361-00d2d5ba5c73 tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] Request method failure captured: Apr 23 03:51:55 user devstack@n-api.service[61306]: request: DELETE /compute/v2.1/servers/08d906c5-1698-4c17-8430-c98f10836398 HTTP/1.1 Apr 23 03:51:55 user devstack@n-api.service[61306]: Accept: application/json Apr 23 03:51:55 user devstack@n-api.service[61306]: Accept-Encoding: identity Apr 23 03:51:55 user devstack@n-api.service[61306]: Connection: close Apr 23 03:51:55 user devstack@n-api.service[61306]: Content-Length: 0 Apr 23 03:51:55 user devstack@n-api.service[61306]: Content-Type: application/json Apr 23 03:51:55 user devstack@n-api.service[61306]: Host: 10.0.0.210 Apr 23 03:51:55 user devstack@n-api.service[61306]: Openstack-System-Scope: None Apr 23 03:51:55 user devstack@n-api.service[61306]: User-Agent: python-urllib3/1.26.15 Apr 23 03:51:55 user devstack@n-api.service[61306]: X-Auth-Token: gAAAAABkRKoEHslY58NoapplHv096IIemOcJ2uEL5fg5YnsrIN7vEVe0goC2-fhyT-4hwLklX7U-s1WIYv72E0xvN5TVTtH79X_fujgCXOgwUZcOoajDGkzv6NTcV4kTMtcgQuvKnfzUIN9o6o81Rg7rqi8gYyC-7qPK6BIPOMDOMMURsNRPwDw Apr 23 03:51:55 user devstack@n-api.service[61306]: X-Domain-Id: None Apr 23 03:51:55 user devstack@n-api.service[61306]: X-Domain-Name: None Apr 23 03:51:55 user devstack@n-api.service[61306]: X-Identity-Status: Confirmed Apr 23 03:51:55 user devstack@n-api.service[61306]: X-Is-Admin-Project: True Apr 23 03:51:55 user devstack@n-api.service[61306]: X-Project-Domain-Id: default Apr 23 03:51:55 user devstack@n-api.service[61306]: X-Project-Domain-Name: Default Apr 23 03:51:55 user devstack@n-api.service[61306]: X-Project-Id: 70b031ddc5c94ca98e7161de03bda4b7 Apr 23 03:51:55 user devstack@n-api.service[61306]: X-Project-Name: tempest-AttachVolumeTestJSON-276721084 Apr 23 03:51:55 user devstack@n-api.service[61306]: X-Role: reader,member Apr 23 03:51:55 user devstack@n-api.service[61306]: X-Roles: reader,member Apr 23 03:51:55 user devstack@n-api.service[61306]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/70b031ddc5c94ca98e7161de03bda4b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/70b031ddc5c94ca98e7161de03bda4b7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/70b031ddc5c94ca98e7161de03bda4b7"}]}] Apr 23 03:51:55 user devstack@n-api.service[61306]: X-Tenant: tempest-AttachVolumeTestJSON-276721084 Apr 23 03:51:55 user devstack@n-api.service[61306]: X-Tenant-Id: 70b031ddc5c94ca98e7161de03bda4b7 Apr 23 03:51:55 user devstack@n-api.service[61306]: X-Tenant-Name: tempest-AttachVolumeTestJSON-276721084 Apr 23 03:51:55 user devstack@n-api.service[61306]: X-User: tempest-AttachVolumeTestJSON-276721084-project-member Apr 23 03:51:55 user devstack@n-api.service[61306]: X-User-Domain-Id: default Apr 23 03:51:55 user devstack@n-api.service[61306]: X-User-Domain-Name: Default Apr 23 03:51:55 user devstack@n-api.service[61306]: X-User-Id: e3d689f1c160478ca83bbff3104d8ec3 Apr 23 03:51:55 user devstack@n-api.service[61306]: X-User-Name: tempest-AttachVolumeTestJSON-276721084-project-member Apr 23 03:51:55 user devstack@n-api.service[61306]: method: > Apr 23 03:51:55 user devstack@n-api.service[61306]: exception: Instance 08d906c5-1698-4c17-8430-c98f10836398 could not be found. Apr 23 03:51:55 user devstack@n-api.service[61306]: action_args: {'id': '08d906c5-1698-4c17-8430-c98f10836398'} Apr 23 03:51:55 user devstack@n-api.service[61306]: {{(pid=61306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 23 03:51:55 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 23 03:51:55 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 23 03:51:55 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 23 03:51:55 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 23 03:51:55 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 23 03:51:55 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 23 03:51:55 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 23 03:51:55 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 23 03:51:55 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 23 03:51:55 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08d906c5-1698-4c17-8430-c98f10836398 could not be found. Apr 23 03:51:55 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi Apr 23 03:51:55 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 23 03:51:55 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi Apr 23 03:51:55 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 23 03:51:55 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 23 03:51:55 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 23 03:51:55 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 23 03:51:55 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 23 03:51:55 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 23 03:51:55 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 23 03:51:55 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 23 03:51:55 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 23 03:51:55 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 23 03:51:55 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 23 03:51:55 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 23 03:51:55 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 23 03:51:55 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 23 03:51:55 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 23 03:51:55 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08d906c5-1698-4c17-8430-c98f10836398 could not be found. Apr 23 03:51:55 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi Apr 23 03:51:55 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 23 03:51:55 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi Apr 23 03:51:55 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 23 03:51:55 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 23 03:51:55 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 23 03:51:55 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 23 03:51:55 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 23 03:51:55 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08d906c5-1698-4c17-8430-c98f10836398 could not be found. Apr 23 03:51:55 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi Apr 23 03:51:55 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi [None req-14a8885f-bb9f-4f52-a361-00d2d5ba5c73 tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] Returning 404 to user: Instance 08d906c5-1698-4c17-8430-c98f10836398 could not be found. {{(pid=61306) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 23 03:51:55 user devstack@n-api.service[61306]: INFO nova.api.openstack.requestlog [None req-14a8885f-bb9f-4f52-a361-00d2d5ba5c73 tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/08d906c5-1698-4c17-8430-c98f10836398" status: 404 len: 111 microversion: 2.1 time: 0.027198 Apr 23 03:51:55 user devstack@n-api.service[61306]: [pid: 61306|app: 0|req: 78/236] 10.0.0.210 () {62 vars in 1316 bytes} [Sun Apr 23 03:51:55 2023] DELETE /compute/v2.1/servers/08d906c5-1698-4c17-8430-c98f10836398 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 23 03:51:55 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi [None req-3d3f6ff0-f624-489a-b6cf-59d2be56378a tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] Calling method '>' {{(pid=61307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 03:51:55 user devstack@n-api.service[61307]: DEBUG nova.compute.api [None req-3d3f6ff0-f624-489a-b6cf-59d2be56378a tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] [instance: 08d906c5-1698-4c17-8430-c98f10836398] Fetching instance by UUID {{(pid=61307) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 23 03:51:55 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-3d3f6ff0-f624-489a-b6cf-59d2be56378a tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:51:55 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-3d3f6ff0-f624-489a-b6cf-59d2be56378a tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:51:55 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-3d3f6ff0-f624-489a-b6cf-59d2be56378a tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:51:55 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-3d3f6ff0-f624-489a-b6cf-59d2be56378a tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:51:55 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-3d3f6ff0-f624-489a-b6cf-59d2be56378a tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:51:55 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-3d3f6ff0-f624-489a-b6cf-59d2be56378a tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:51:55 user devstack@n-api.service[61307]: INFO nova.api.openstack.wsgi [None req-3d3f6ff0-f624-489a-b6cf-59d2be56378a tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] HTTP exception thrown: Instance 08d906c5-1698-4c17-8430-c98f10836398 could not be found. Apr 23 03:51:55 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi [None req-3d3f6ff0-f624-489a-b6cf-59d2be56378a tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] Request method failure captured: Apr 23 03:51:55 user devstack@n-api.service[61307]: request: GET /compute/v2.1/servers/08d906c5-1698-4c17-8430-c98f10836398 HTTP/1.1 Apr 23 03:51:55 user devstack@n-api.service[61307]: Accept: application/json Apr 23 03:51:55 user devstack@n-api.service[61307]: Accept-Encoding: identity Apr 23 03:51:55 user devstack@n-api.service[61307]: Connection: close Apr 23 03:51:55 user devstack@n-api.service[61307]: Content-Length: 0 Apr 23 03:51:55 user devstack@n-api.service[61307]: Content-Type: application/json Apr 23 03:51:55 user devstack@n-api.service[61307]: Host: 10.0.0.210 Apr 23 03:51:55 user devstack@n-api.service[61307]: Openstack-System-Scope: None Apr 23 03:51:55 user devstack@n-api.service[61307]: User-Agent: python-urllib3/1.26.15 Apr 23 03:51:55 user devstack@n-api.service[61307]: X-Auth-Token: gAAAAABkRKoEHslY58NoapplHv096IIemOcJ2uEL5fg5YnsrIN7vEVe0goC2-fhyT-4hwLklX7U-s1WIYv72E0xvN5TVTtH79X_fujgCXOgwUZcOoajDGkzv6NTcV4kTMtcgQuvKnfzUIN9o6o81Rg7rqi8gYyC-7qPK6BIPOMDOMMURsNRPwDw Apr 23 03:51:55 user devstack@n-api.service[61307]: X-Domain-Id: None Apr 23 03:51:55 user devstack@n-api.service[61307]: X-Domain-Name: None Apr 23 03:51:55 user devstack@n-api.service[61307]: X-Identity-Status: Confirmed Apr 23 03:51:55 user devstack@n-api.service[61307]: X-Is-Admin-Project: True Apr 23 03:51:55 user devstack@n-api.service[61307]: X-Project-Domain-Id: default Apr 23 03:51:55 user devstack@n-api.service[61307]: X-Project-Domain-Name: Default Apr 23 03:51:55 user devstack@n-api.service[61307]: X-Project-Id: 70b031ddc5c94ca98e7161de03bda4b7 Apr 23 03:51:55 user devstack@n-api.service[61307]: X-Project-Name: tempest-AttachVolumeTestJSON-276721084 Apr 23 03:51:55 user devstack@n-api.service[61307]: X-Role: reader,member Apr 23 03:51:55 user devstack@n-api.service[61307]: X-Roles: reader,member Apr 23 03:51:55 user devstack@n-api.service[61307]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/70b031ddc5c94ca98e7161de03bda4b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/70b031ddc5c94ca98e7161de03bda4b7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/70b031ddc5c94ca98e7161de03bda4b7"}]}] Apr 23 03:51:55 user devstack@n-api.service[61307]: X-Tenant: tempest-AttachVolumeTestJSON-276721084 Apr 23 03:51:55 user devstack@n-api.service[61307]: X-Tenant-Id: 70b031ddc5c94ca98e7161de03bda4b7 Apr 23 03:51:55 user devstack@n-api.service[61307]: X-Tenant-Name: tempest-AttachVolumeTestJSON-276721084 Apr 23 03:51:55 user devstack@n-api.service[61307]: X-User: tempest-AttachVolumeTestJSON-276721084-project-member Apr 23 03:51:55 user devstack@n-api.service[61307]: X-User-Domain-Id: default Apr 23 03:51:55 user devstack@n-api.service[61307]: X-User-Domain-Name: Default Apr 23 03:51:55 user devstack@n-api.service[61307]: X-User-Id: e3d689f1c160478ca83bbff3104d8ec3 Apr 23 03:51:55 user devstack@n-api.service[61307]: X-User-Name: tempest-AttachVolumeTestJSON-276721084-project-member Apr 23 03:51:55 user devstack@n-api.service[61307]: method: > Apr 23 03:51:55 user devstack@n-api.service[61307]: exception: Instance 08d906c5-1698-4c17-8430-c98f10836398 could not be found. Apr 23 03:51:55 user devstack@n-api.service[61307]: action_args: {'id': '08d906c5-1698-4c17-8430-c98f10836398'} Apr 23 03:51:55 user devstack@n-api.service[61307]: {{(pid=61307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 23 03:51:55 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 23 03:51:55 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 23 03:51:55 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 23 03:51:55 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 23 03:51:55 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 23 03:51:55 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 23 03:51:55 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 23 03:51:55 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 23 03:51:55 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 23 03:51:55 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08d906c5-1698-4c17-8430-c98f10836398 could not be found. Apr 23 03:51:55 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi Apr 23 03:51:55 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 23 03:51:55 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi Apr 23 03:51:55 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 23 03:51:55 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 23 03:51:55 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 23 03:51:55 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 23 03:51:55 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 23 03:51:55 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 23 03:51:55 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 23 03:51:55 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 23 03:51:55 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 23 03:51:55 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 23 03:51:55 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 23 03:51:55 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 23 03:51:55 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 23 03:51:55 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08d906c5-1698-4c17-8430-c98f10836398 could not be found. Apr 23 03:51:55 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi Apr 23 03:51:55 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 23 03:51:55 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi Apr 23 03:51:55 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 23 03:51:55 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 23 03:51:55 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 23 03:51:55 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 23 03:51:55 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 23 03:51:55 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08d906c5-1698-4c17-8430-c98f10836398 could not be found. Apr 23 03:51:55 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi Apr 23 03:51:55 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi [None req-3d3f6ff0-f624-489a-b6cf-59d2be56378a tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] Returning 404 to user: Instance 08d906c5-1698-4c17-8430-c98f10836398 could not be found. {{(pid=61307) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 23 03:51:55 user devstack@n-api.service[61307]: INFO nova.api.openstack.requestlog [None req-3d3f6ff0-f624-489a-b6cf-59d2be56378a tempest-AttachVolumeTestJSON-276721084 tempest-AttachVolumeTestJSON-276721084-project-member] 10.0.0.210 "GET /compute/v2.1/servers/08d906c5-1698-4c17-8430-c98f10836398" status: 404 len: 111 microversion: 2.1 time: 0.032943 Apr 23 03:51:55 user devstack@n-api.service[61307]: [pid: 61307|app: 0|req: 79/237] 10.0.0.210 () {62 vars in 1313 bytes} [Sun Apr 23 03:51:55 2023] GET /compute/v2.1/servers/08d906c5-1698-4c17-8430-c98f10836398 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 23 03:51:55 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi [None req-393fc113-b524-44d7-a350-1bf470665acd tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Calling method '>' {{(pid=61308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 03:51:55 user devstack@n-api.service[61308]: DEBUG nova.compute.api [None req-393fc113-b524-44d7-a350-1bf470665acd tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] [instance: 7c1f1f24-62f5-4e51-8c74-b5b89b6585a4] Fetching instance by UUID {{(pid=61308) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 23 03:51:55 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-393fc113-b524-44d7-a350-1bf470665acd tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:51:55 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-393fc113-b524-44d7-a350-1bf470665acd tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:51:55 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-393fc113-b524-44d7-a350-1bf470665acd tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:51:55 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-393fc113-b524-44d7-a350-1bf470665acd tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:51:55 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-393fc113-b524-44d7-a350-1bf470665acd tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:51:55 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-393fc113-b524-44d7-a350-1bf470665acd tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:51:55 user devstack@n-api.service[61308]: INFO nova.api.openstack.requestlog [None req-393fc113-b524-44d7-a350-1bf470665acd tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7c1f1f24-62f5-4e51-8c74-b5b89b6585a4/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.208029 Apr 23 03:51:55 user devstack@n-api.service[61308]: [pid: 61308|app: 0|req: 81/238] 10.0.0.210 () {62 vars in 1352 bytes} [Sun Apr 23 03:51:55 2023] GET /compute/v2.1/servers/7c1f1f24-62f5-4e51-8c74-b5b89b6585a4/os-interface => generated 283 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 23 03:51:56 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi [req-a811da9d-24ad-457c-97ac-323b43183866 req-df9bf5e1-b4dc-4103-9425-ded6a644cc1f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c1f1f24-62f5-4e51-8c74-b5b89b6585a4", "tag": "2a195833-5430-4cc1-a938-5b4157c32300"}]} {{(pid=61306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 03:51:56 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi [None req-0fab435c-cf7d-4754-b1c0-276317387b45 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Calling method '>' {{(pid=61307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 03:51:56 user devstack@n-api.service[61307]: DEBUG nova.compute.api [None req-0fab435c-cf7d-4754-b1c0-276317387b45 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] [instance: 7c1f1f24-62f5-4e51-8c74-b5b89b6585a4] Fetching instance by UUID {{(pid=61307) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 23 03:51:56 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-0fab435c-cf7d-4754-b1c0-276317387b45 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:51:56 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-0fab435c-cf7d-4754-b1c0-276317387b45 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:51:56 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [req-a811da9d-24ad-457c-97ac-323b43183866 req-df9bf5e1-b4dc-4103-9425-ded6a644cc1f service nova] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:51:56 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-0fab435c-cf7d-4754-b1c0-276317387b45 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:51:56 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-0fab435c-cf7d-4754-b1c0-276317387b45 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:51:56 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [req-a811da9d-24ad-457c-97ac-323b43183866 req-df9bf5e1-b4dc-4103-9425-ded6a644cc1f service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:51:56 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-0fab435c-cf7d-4754-b1c0-276317387b45 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:51:56 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [req-a811da9d-24ad-457c-97ac-323b43183866 req-df9bf5e1-b4dc-4103-9425-ded6a644cc1f service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:51:56 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-0fab435c-cf7d-4754-b1c0-276317387b45 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:51:56 user devstack@n-api.service[61306]: INFO nova.api.openstack.compute.server_external_events [req-a811da9d-24ad-457c-97ac-323b43183866 req-df9bf5e1-b4dc-4103-9425-ded6a644cc1f service nova] Creating event network-changed:2a195833-5430-4cc1-a938-5b4157c32300 for instance 7c1f1f24-62f5-4e51-8c74-b5b89b6585a4 on user Apr 23 03:51:56 user devstack@n-api.service[61306]: INFO nova.api.openstack.requestlog [req-a811da9d-24ad-457c-97ac-323b43183866 req-df9bf5e1-b4dc-4103-9425-ded6a644cc1f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093160 Apr 23 03:51:56 user devstack@n-api.service[61306]: [pid: 61306|app: 0|req: 79/239] 10.0.0.210 () {68 vars in 1394 bytes} [Sun Apr 23 03:51:56 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 23 03:51:56 user devstack@n-api.service[61307]: INFO nova.api.openstack.requestlog [None req-0fab435c-cf7d-4754-b1c0-276317387b45 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7c1f1f24-62f5-4e51-8c74-b5b89b6585a4/ips" status: 200 len: 108 microversion: 2.1 time: 0.043935 Apr 23 03:51:56 user devstack@n-api.service[61307]: [pid: 61307|app: 0|req: 80/240] 10.0.0.210 () {62 vars in 1325 bytes} [Sun Apr 23 03:51:56 2023] GET /compute/v2.1/servers/7c1f1f24-62f5-4e51-8c74-b5b89b6585a4/ips => generated 108 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 23 03:51:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi [None req-f5a4f6f0-adfe-4bbf-89e4-440aa90c9188 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Calling method '>' {{(pid=61308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 03:51:57 user devstack@n-api.service[61308]: DEBUG nova.compute.api [None req-f5a4f6f0-adfe-4bbf-89e4-440aa90c9188 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] [instance: 7c1f1f24-62f5-4e51-8c74-b5b89b6585a4] Fetching instance by UUID {{(pid=61308) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 23 03:51:57 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-f5a4f6f0-adfe-4bbf-89e4-440aa90c9188 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:51:57 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-f5a4f6f0-adfe-4bbf-89e4-440aa90c9188 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:51:57 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-f5a4f6f0-adfe-4bbf-89e4-440aa90c9188 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:51:57 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-f5a4f6f0-adfe-4bbf-89e4-440aa90c9188 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:51:57 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-f5a4f6f0-adfe-4bbf-89e4-440aa90c9188 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:51:57 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-f5a4f6f0-adfe-4bbf-89e4-440aa90c9188 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:51:57 user devstack@n-api.service[61308]: DEBUG nova.compute.api [None req-f5a4f6f0-adfe-4bbf-89e4-440aa90c9188 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] [instance: 7c1f1f24-62f5-4e51-8c74-b5b89b6585a4] Going to try to terminate instance {{(pid=61308) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 23 03:51:57 user devstack@n-api.service[61308]: INFO nova.api.openstack.requestlog [None req-f5a4f6f0-adfe-4bbf-89e4-440aa90c9188 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/7c1f1f24-62f5-4e51-8c74-b5b89b6585a4" status: 204 len: 0 microversion: 2.1 time: 0.115862 Apr 23 03:51:57 user devstack@n-api.service[61308]: [pid: 61308|app: 0|req: 82/241] 10.0.0.210 () {62 vars in 1316 bytes} [Sun Apr 23 03:51:57 2023] DELETE /compute/v2.1/servers/7c1f1f24-62f5-4e51-8c74-b5b89b6585a4 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 23 03:51:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi [None req-d9f569cf-804c-4517-8e96-4fd813a930c1 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Calling method '>' {{(pid=61306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 03:51:57 user devstack@n-api.service[61306]: DEBUG nova.compute.api [None req-d9f569cf-804c-4517-8e96-4fd813a930c1 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] [instance: 7c1f1f24-62f5-4e51-8c74-b5b89b6585a4] Fetching instance by UUID {{(pid=61306) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 23 03:51:57 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-d9f569cf-804c-4517-8e96-4fd813a930c1 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:51:57 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-d9f569cf-804c-4517-8e96-4fd813a930c1 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:51:57 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-d9f569cf-804c-4517-8e96-4fd813a930c1 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:51:57 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-d9f569cf-804c-4517-8e96-4fd813a930c1 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:51:57 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-d9f569cf-804c-4517-8e96-4fd813a930c1 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:51:57 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-d9f569cf-804c-4517-8e96-4fd813a930c1 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:51:58 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi [req-a699f8e1-a04d-4eb9-9e0c-30535965a791 req-8e75d13b-c86e-4e6b-9d5c-969b84225609 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c1f1f24-62f5-4e51-8c74-b5b89b6585a4", "name": "network-vif-unplugged", "status": "completed", "tag": "2a195833-5430-4cc1-a938-5b4157c32300"}]} {{(pid=61307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 03:51:58 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [req-a699f8e1-a04d-4eb9-9e0c-30535965a791 req-8e75d13b-c86e-4e6b-9d5c-969b84225609 service nova] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:51:58 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [req-a699f8e1-a04d-4eb9-9e0c-30535965a791 req-8e75d13b-c86e-4e6b-9d5c-969b84225609 service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:51:58 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [req-a699f8e1-a04d-4eb9-9e0c-30535965a791 req-8e75d13b-c86e-4e6b-9d5c-969b84225609 service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:51:58 user devstack@n-api.service[61307]: INFO nova.api.openstack.compute.server_external_events [req-a699f8e1-a04d-4eb9-9e0c-30535965a791 req-8e75d13b-c86e-4e6b-9d5c-969b84225609 service nova] Creating event network-vif-unplugged:2a195833-5430-4cc1-a938-5b4157c32300 for instance 7c1f1f24-62f5-4e51-8c74-b5b89b6585a4 on user Apr 23 03:51:58 user devstack@n-api.service[61307]: INFO nova.api.openstack.requestlog [req-a699f8e1-a04d-4eb9-9e0c-30535965a791 req-8e75d13b-c86e-4e6b-9d5c-969b84225609 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.092063 Apr 23 03:51:58 user devstack@n-api.service[61307]: [pid: 61307|app: 0|req: 81/242] 10.0.0.210 () {68 vars in 1394 bytes} [Sun Apr 23 03:51:58 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 23 03:51:58 user devstack@n-api.service[61306]: DEBUG nova.policy [None req-d9f569cf-804c-4517-8e96-4fd813a930c1 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2c459cad014b07b2613e5e261d88aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24fff486a500421397ecb935828582cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61306) authorize /opt/stack/nova/nova/policy.py:203}} Apr 23 03:51:58 user devstack@n-api.service[61306]: INFO nova.api.openstack.requestlog [None req-d9f569cf-804c-4517-8e96-4fd813a930c1 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7c1f1f24-62f5-4e51-8c74-b5b89b6585a4" status: 200 len: 1669 microversion: 2.1 time: 0.390243 Apr 23 03:51:58 user devstack@n-api.service[61306]: [pid: 61306|app: 0|req: 80/243] 10.0.0.210 () {62 vars in 1313 bytes} [Sun Apr 23 03:51:57 2023] GET /compute/v2.1/servers/7c1f1f24-62f5-4e51-8c74-b5b89b6585a4 => generated 1669 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 23 03:52:00 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi [None req-580451eb-a4fe-4a58-9c24-c92cdd231873 tempest-VolumesSnapshotsTestJSON-520656398 tempest-VolumesSnapshotsTestJSON-520656398-project-member] Action: 'create', calling method: .version_select at 0x7f21e111bc70>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-815708944"}} {{(pid=61308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 03:52:00 user devstack@n-api.service[61308]: INFO nova.api.openstack.requestlog [None req-580451eb-a4fe-4a58-9c24-c92cdd231873 tempest-VolumesSnapshotsTestJSON-520656398 tempest-VolumesSnapshotsTestJSON-520656398-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.417062 Apr 23 03:52:00 user devstack@n-api.service[61308]: [pid: 61308|app: 0|req: 83/244] 10.0.0.210 () {64 vars in 1232 bytes} [Sun Apr 23 03:51:59 2023] POST /compute/v2.1/os-volumes => generated 344 bytes in 419 msecs (HTTP/1.1 200) 10 headers in 447 bytes (1 switches on core 0) Apr 23 03:52:00 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi [req-37969772-c240-4c08-9616-371d05ccd222 req-995db8f4-8a52-414d-bc0d-ca2cc638480f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c1f1f24-62f5-4e51-8c74-b5b89b6585a4", "name": "network-vif-plugged", "status": "completed", "tag": "2a195833-5430-4cc1-a938-5b4157c32300"}, {"server_uuid": "7c1f1f24-62f5-4e51-8c74-b5b89b6585a4", "name": "network-vif-plugged", "status": "completed", "tag": "2a195833-5430-4cc1-a938-5b4157c32300"}, {"server_uuid": "7c1f1f24-62f5-4e51-8c74-b5b89b6585a4", "name": "network-vif-plugged", "status": "completed", "tag": "2a195833-5430-4cc1-a938-5b4157c32300"}, {"server_uuid": "7c1f1f24-62f5-4e51-8c74-b5b89b6585a4", "name": "network-vif-unplugged", "status": "completed", "tag": "2a195833-5430-4cc1-a938-5b4157c32300"}]} {{(pid=61307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 03:52:00 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi [None req-cc06c243-486a-4664-a244-461e9f27a853 tempest-VolumesSnapshotsTestJSON-520656398 tempest-VolumesSnapshotsTestJSON-520656398-project-member] Calling method '.version_select at 0x7f21e12b1510>' {{(pid=61306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 03:52:00 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [req-37969772-c240-4c08-9616-371d05ccd222 req-995db8f4-8a52-414d-bc0d-ca2cc638480f service nova] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:52:00 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [req-37969772-c240-4c08-9616-371d05ccd222 req-995db8f4-8a52-414d-bc0d-ca2cc638480f service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:52:00 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [req-37969772-c240-4c08-9616-371d05ccd222 req-995db8f4-8a52-414d-bc0d-ca2cc638480f service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:52:00 user devstack@n-api.service[61307]: INFO nova.api.openstack.compute.server_external_events [req-37969772-c240-4c08-9616-371d05ccd222 req-995db8f4-8a52-414d-bc0d-ca2cc638480f service nova] Creating event network-vif-plugged:2a195833-5430-4cc1-a938-5b4157c32300 for instance 7c1f1f24-62f5-4e51-8c74-b5b89b6585a4 on user Apr 23 03:52:00 user devstack@n-api.service[61307]: INFO nova.api.openstack.compute.server_external_events [req-37969772-c240-4c08-9616-371d05ccd222 req-995db8f4-8a52-414d-bc0d-ca2cc638480f service nova] Creating event network-vif-plugged:2a195833-5430-4cc1-a938-5b4157c32300 for instance 7c1f1f24-62f5-4e51-8c74-b5b89b6585a4 on user Apr 23 03:52:00 user devstack@n-api.service[61307]: INFO nova.api.openstack.compute.server_external_events [req-37969772-c240-4c08-9616-371d05ccd222 req-995db8f4-8a52-414d-bc0d-ca2cc638480f service nova] Creating event network-vif-plugged:2a195833-5430-4cc1-a938-5b4157c32300 for instance 7c1f1f24-62f5-4e51-8c74-b5b89b6585a4 on user Apr 23 03:52:00 user devstack@n-api.service[61307]: INFO nova.api.openstack.compute.server_external_events [req-37969772-c240-4c08-9616-371d05ccd222 req-995db8f4-8a52-414d-bc0d-ca2cc638480f service nova] Creating event network-vif-unplugged:2a195833-5430-4cc1-a938-5b4157c32300 for instance 7c1f1f24-62f5-4e51-8c74-b5b89b6585a4 on user Apr 23 03:52:00 user devstack@n-api.service[61307]: INFO nova.api.openstack.requestlog [req-37969772-c240-4c08-9616-371d05ccd222 req-995db8f4-8a52-414d-bc0d-ca2cc638480f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 698 microversion: 2.1 time: 0.030439 Apr 23 03:52:00 user devstack@n-api.service[61307]: [pid: 61307|app: 0|req: 82/245] 10.0.0.210 () {68 vars in 1394 bytes} [Sun Apr 23 03:52:00 2023] POST /compute/v2.1/os-server-external-events => generated 698 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 23 03:52:00 user devstack@n-api.service[61306]: INFO nova.api.openstack.requestlog [None req-cc06c243-486a-4664-a244-461e9f27a853 tempest-VolumesSnapshotsTestJSON-520656398 tempest-VolumesSnapshotsTestJSON-520656398-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/130dcf61-3ca4-4e4d-be23-d73f877cd11d" status: 200 len: 341 microversion: 2.1 time: 0.055295 Apr 23 03:52:00 user devstack@n-api.service[61306]: [pid: 61306|app: 0|req: 81/246] 10.0.0.210 () {62 vars in 1322 bytes} [Sun Apr 23 03:52:00 2023] GET /compute/v2.1/os-volumes/130dcf61-3ca4-4e4d-be23-d73f877cd11d => generated 341 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 23 03:52:01 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi [None req-6c88243d-a9ef-41ff-b520-453cdede66fa tempest-VolumesAdminNegativeTest-594073230 tempest-VolumesAdminNegativeTest-594073230-project-member] Calling method '>' {{(pid=61308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 03:52:01 user devstack@n-api.service[61308]: DEBUG nova.compute.api [None req-6c88243d-a9ef-41ff-b520-453cdede66fa tempest-VolumesAdminNegativeTest-594073230 tempest-VolumesAdminNegativeTest-594073230-project-member] [instance: 1d5ec75f-29f2-45c3-8d6e-74d9ec8b2f86] Fetching instance by UUID {{(pid=61308) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 23 03:52:01 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-6c88243d-a9ef-41ff-b520-453cdede66fa tempest-VolumesAdminNegativeTest-594073230 tempest-VolumesAdminNegativeTest-594073230-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:52:01 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-6c88243d-a9ef-41ff-b520-453cdede66fa tempest-VolumesAdminNegativeTest-594073230 tempest-VolumesAdminNegativeTest-594073230-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:52:01 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-6c88243d-a9ef-41ff-b520-453cdede66fa tempest-VolumesAdminNegativeTest-594073230 tempest-VolumesAdminNegativeTest-594073230-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:52:01 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-6c88243d-a9ef-41ff-b520-453cdede66fa tempest-VolumesAdminNegativeTest-594073230 tempest-VolumesAdminNegativeTest-594073230-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:52:01 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-6c88243d-a9ef-41ff-b520-453cdede66fa tempest-VolumesAdminNegativeTest-594073230 tempest-VolumesAdminNegativeTest-594073230-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:52:01 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-6c88243d-a9ef-41ff-b520-453cdede66fa tempest-VolumesAdminNegativeTest-594073230 tempest-VolumesAdminNegativeTest-594073230-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:52:01 user devstack@n-api.service[61308]: INFO nova.api.openstack.wsgi [None req-6c88243d-a9ef-41ff-b520-453cdede66fa tempest-VolumesAdminNegativeTest-594073230 tempest-VolumesAdminNegativeTest-594073230-project-member] HTTP exception thrown: Instance 1d5ec75f-29f2-45c3-8d6e-74d9ec8b2f86 could not be found. Apr 23 03:52:01 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi [None req-6c88243d-a9ef-41ff-b520-453cdede66fa tempest-VolumesAdminNegativeTest-594073230 tempest-VolumesAdminNegativeTest-594073230-project-member] Request method failure captured: Apr 23 03:52:01 user devstack@n-api.service[61308]: request: GET /compute/v2.1/servers/1d5ec75f-29f2-45c3-8d6e-74d9ec8b2f86 HTTP/1.1 Apr 23 03:52:01 user devstack@n-api.service[61308]: Accept: application/json Apr 23 03:52:01 user devstack@n-api.service[61308]: Accept-Encoding: identity Apr 23 03:52:01 user devstack@n-api.service[61308]: Connection: close Apr 23 03:52:01 user devstack@n-api.service[61308]: Content-Length: 0 Apr 23 03:52:01 user devstack@n-api.service[61308]: Content-Type: application/json Apr 23 03:52:01 user devstack@n-api.service[61308]: Host: 10.0.0.210 Apr 23 03:52:01 user devstack@n-api.service[61308]: Openstack-System-Scope: None Apr 23 03:52:01 user devstack@n-api.service[61308]: User-Agent: python-urllib3/1.26.15 Apr 23 03:52:01 user devstack@n-api.service[61308]: X-Auth-Token: gAAAAABkRKo7Cds5ZlyNxxlsfeb9wXDvomZDOKxYSlMZqrfQWO16gEBrdjeg1HP-0NEMAOJMrby_4c0WJHes13qxtnKqP1gK985awixigq-bI0SCZvPKg31tiBgD6bvzqOnjW7y2a1fvOE0pWu1Gettr1j-2C4NLqM5vCoUalTE-eilg4IlGLDI Apr 23 03:52:01 user devstack@n-api.service[61308]: X-Domain-Id: None Apr 23 03:52:01 user devstack@n-api.service[61308]: X-Domain-Name: None Apr 23 03:52:01 user devstack@n-api.service[61308]: X-Identity-Status: Confirmed Apr 23 03:52:01 user devstack@n-api.service[61308]: X-Is-Admin-Project: True Apr 23 03:52:01 user devstack@n-api.service[61308]: X-Project-Domain-Id: default Apr 23 03:52:01 user devstack@n-api.service[61308]: X-Project-Domain-Name: Default Apr 23 03:52:01 user devstack@n-api.service[61308]: X-Project-Id: 5eb0a03655cf4aa78e27c81ea4e1c424 Apr 23 03:52:01 user devstack@n-api.service[61308]: X-Project-Name: tempest-VolumesAdminNegativeTest-594073230 Apr 23 03:52:01 user devstack@n-api.service[61308]: X-Role: reader,member Apr 23 03:52:01 user devstack@n-api.service[61308]: X-Roles: reader,member Apr 23 03:52:01 user devstack@n-api.service[61308]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5eb0a03655cf4aa78e27c81ea4e1c424"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5eb0a03655cf4aa78e27c81ea4e1c424"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/5eb0a03655cf4aa78e27c81ea4e1c424"}]}] Apr 23 03:52:01 user devstack@n-api.service[61308]: X-Tenant: tempest-VolumesAdminNegativeTest-594073230 Apr 23 03:52:01 user devstack@n-api.service[61308]: X-Tenant-Id: 5eb0a03655cf4aa78e27c81ea4e1c424 Apr 23 03:52:01 user devstack@n-api.service[61308]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-594073230 Apr 23 03:52:01 user devstack@n-api.service[61308]: X-User: tempest-VolumesAdminNegativeTest-594073230-project-member Apr 23 03:52:01 user devstack@n-api.service[61308]: X-User-Domain-Id: default Apr 23 03:52:01 user devstack@n-api.service[61308]: X-User-Domain-Name: Default Apr 23 03:52:01 user devstack@n-api.service[61308]: X-User-Id: 3e80c354abd34bd3a28ddaeec9535af2 Apr 23 03:52:01 user devstack@n-api.service[61308]: X-User-Name: tempest-VolumesAdminNegativeTest-594073230-project-member Apr 23 03:52:01 user devstack@n-api.service[61308]: method: > Apr 23 03:52:01 user devstack@n-api.service[61308]: exception: Instance 1d5ec75f-29f2-45c3-8d6e-74d9ec8b2f86 could not be found. Apr 23 03:52:01 user devstack@n-api.service[61308]: action_args: {'id': '1d5ec75f-29f2-45c3-8d6e-74d9ec8b2f86'} Apr 23 03:52:01 user devstack@n-api.service[61308]: {{(pid=61308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 23 03:52:01 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 23 03:52:01 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 23 03:52:01 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 23 03:52:01 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 23 03:52:01 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 23 03:52:01 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 23 03:52:01 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 23 03:52:01 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 23 03:52:01 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 23 03:52:01 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d5ec75f-29f2-45c3-8d6e-74d9ec8b2f86 could not be found. Apr 23 03:52:01 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi Apr 23 03:52:01 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 23 03:52:01 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi Apr 23 03:52:01 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 23 03:52:01 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 23 03:52:01 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 23 03:52:01 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 23 03:52:01 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 23 03:52:01 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 23 03:52:01 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 23 03:52:01 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 23 03:52:01 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 23 03:52:01 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 23 03:52:01 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 23 03:52:01 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 23 03:52:01 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 23 03:52:01 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d5ec75f-29f2-45c3-8d6e-74d9ec8b2f86 could not be found. Apr 23 03:52:01 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi Apr 23 03:52:01 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 23 03:52:01 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi Apr 23 03:52:01 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 23 03:52:01 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 23 03:52:01 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 23 03:52:01 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 23 03:52:01 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 23 03:52:01 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d5ec75f-29f2-45c3-8d6e-74d9ec8b2f86 could not be found. Apr 23 03:52:01 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi Apr 23 03:52:01 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi [None req-6c88243d-a9ef-41ff-b520-453cdede66fa tempest-VolumesAdminNegativeTest-594073230 tempest-VolumesAdminNegativeTest-594073230-project-member] Returning 404 to user: Instance 1d5ec75f-29f2-45c3-8d6e-74d9ec8b2f86 could not be found. {{(pid=61308) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 23 03:52:01 user devstack@n-api.service[61308]: INFO nova.api.openstack.requestlog [None req-6c88243d-a9ef-41ff-b520-453cdede66fa tempest-VolumesAdminNegativeTest-594073230 tempest-VolumesAdminNegativeTest-594073230-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1d5ec75f-29f2-45c3-8d6e-74d9ec8b2f86" status: 404 len: 111 microversion: 2.1 time: 0.028567 Apr 23 03:52:01 user devstack@n-api.service[61308]: [pid: 61308|app: 0|req: 84/247] 10.0.0.210 () {62 vars in 1313 bytes} [Sun Apr 23 03:52:01 2023] GET /compute/v2.1/servers/1d5ec75f-29f2-45c3-8d6e-74d9ec8b2f86 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 23 03:52:01 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi [None req-50a93b4e-fa0e-4ec3-bdbf-043f6a3b944e tempest-VolumesSnapshotsTestJSON-520656398 tempest-VolumesSnapshotsTestJSON-520656398-project-member] Calling method '.version_select at 0x7f21e1201cf0>' {{(pid=61307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 03:52:01 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi [None req-f9eaf523-7034-4ec3-8c27-bd4d5e3d74c9 tempest-VolumesAdminNegativeTest-594073230 tempest-VolumesAdminNegativeTest-594073230-project-member] Calling method '>' {{(pid=61306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 03:52:01 user devstack@n-api.service[61306]: DEBUG nova.compute.api [None req-f9eaf523-7034-4ec3-8c27-bd4d5e3d74c9 tempest-VolumesAdminNegativeTest-594073230 tempest-VolumesAdminNegativeTest-594073230-project-member] [instance: 91756f90-733e-4aa5-9108-d2d8b1d020fe] Fetching instance by UUID {{(pid=61306) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 23 03:52:01 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-f9eaf523-7034-4ec3-8c27-bd4d5e3d74c9 tempest-VolumesAdminNegativeTest-594073230 tempest-VolumesAdminNegativeTest-594073230-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:52:01 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-f9eaf523-7034-4ec3-8c27-bd4d5e3d74c9 tempest-VolumesAdminNegativeTest-594073230 tempest-VolumesAdminNegativeTest-594073230-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:52:01 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-f9eaf523-7034-4ec3-8c27-bd4d5e3d74c9 tempest-VolumesAdminNegativeTest-594073230 tempest-VolumesAdminNegativeTest-594073230-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:52:01 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-f9eaf523-7034-4ec3-8c27-bd4d5e3d74c9 tempest-VolumesAdminNegativeTest-594073230 tempest-VolumesAdminNegativeTest-594073230-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:52:01 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-f9eaf523-7034-4ec3-8c27-bd4d5e3d74c9 tempest-VolumesAdminNegativeTest-594073230 tempest-VolumesAdminNegativeTest-594073230-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:52:01 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-f9eaf523-7034-4ec3-8c27-bd4d5e3d74c9 tempest-VolumesAdminNegativeTest-594073230 tempest-VolumesAdminNegativeTest-594073230-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:52:01 user devstack@n-api.service[61307]: INFO nova.api.openstack.requestlog [None req-50a93b4e-fa0e-4ec3-bdbf-043f6a3b944e tempest-VolumesSnapshotsTestJSON-520656398 tempest-VolumesSnapshotsTestJSON-520656398-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/130dcf61-3ca4-4e4d-be23-d73f877cd11d" status: 200 len: 341 microversion: 2.1 time: 0.049243 Apr 23 03:52:01 user devstack@n-api.service[61307]: [pid: 61307|app: 0|req: 83/248] 10.0.0.210 () {62 vars in 1322 bytes} [Sun Apr 23 03:52:01 2023] GET /compute/v2.1/os-volumes/130dcf61-3ca4-4e4d-be23-d73f877cd11d => generated 341 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 23 03:52:01 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi [None req-5808af0a-40c2-4635-bfde-6de95a98ebef tempest-VolumesSnapshotsTestJSON-520656398 tempest-VolumesSnapshotsTestJSON-520656398-project-member] Calling method '.version_select at 0x7f21e113b760>' {{(pid=61308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 03:52:01 user devstack@n-api.service[61306]: DEBUG nova.compute.api [None req-f9eaf523-7034-4ec3-8c27-bd4d5e3d74c9 tempest-VolumesAdminNegativeTest-594073230 tempest-VolumesAdminNegativeTest-594073230-project-member] [instance: 91756f90-733e-4aa5-9108-d2d8b1d020fe] Going to try to terminate instance {{(pid=61306) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 23 03:52:01 user devstack@n-api.service[61306]: INFO nova.api.openstack.requestlog [None req-f9eaf523-7034-4ec3-8c27-bd4d5e3d74c9 tempest-VolumesAdminNegativeTest-594073230 tempest-VolumesAdminNegativeTest-594073230-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/91756f90-733e-4aa5-9108-d2d8b1d020fe" status: 204 len: 0 microversion: 2.1 time: 0.110225 Apr 23 03:52:01 user devstack@n-api.service[61306]: [pid: 61306|app: 0|req: 82/249] 10.0.0.210 () {62 vars in 1316 bytes} [Sun Apr 23 03:52:01 2023] DELETE /compute/v2.1/servers/91756f90-733e-4aa5-9108-d2d8b1d020fe => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 23 03:52:01 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi [None req-8dba9e69-1a0a-4645-9dde-30215c3b07e5 tempest-VolumesAdminNegativeTest-594073230 tempest-VolumesAdminNegativeTest-594073230-project-member] Calling method '>' {{(pid=61307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 03:52:01 user devstack@n-api.service[61307]: DEBUG nova.compute.api [None req-8dba9e69-1a0a-4645-9dde-30215c3b07e5 tempest-VolumesAdminNegativeTest-594073230 tempest-VolumesAdminNegativeTest-594073230-project-member] [instance: 91756f90-733e-4aa5-9108-d2d8b1d020fe] Fetching instance by UUID {{(pid=61307) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 23 03:52:01 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-8dba9e69-1a0a-4645-9dde-30215c3b07e5 tempest-VolumesAdminNegativeTest-594073230 tempest-VolumesAdminNegativeTest-594073230-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:52:01 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-8dba9e69-1a0a-4645-9dde-30215c3b07e5 tempest-VolumesAdminNegativeTest-594073230 tempest-VolumesAdminNegativeTest-594073230-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:52:01 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-8dba9e69-1a0a-4645-9dde-30215c3b07e5 tempest-VolumesAdminNegativeTest-594073230 tempest-VolumesAdminNegativeTest-594073230-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:52:01 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-8dba9e69-1a0a-4645-9dde-30215c3b07e5 tempest-VolumesAdminNegativeTest-594073230 tempest-VolumesAdminNegativeTest-594073230-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:52:01 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-8dba9e69-1a0a-4645-9dde-30215c3b07e5 tempest-VolumesAdminNegativeTest-594073230 tempest-VolumesAdminNegativeTest-594073230-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:52:01 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-8dba9e69-1a0a-4645-9dde-30215c3b07e5 tempest-VolumesAdminNegativeTest-594073230 tempest-VolumesAdminNegativeTest-594073230-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:52:01 user devstack@n-api.service[61308]: INFO nova.api.openstack.requestlog [None req-5808af0a-40c2-4635-bfde-6de95a98ebef tempest-VolumesSnapshotsTestJSON-520656398 tempest-VolumesSnapshotsTestJSON-520656398-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/130dcf61-3ca4-4e4d-be23-d73f877cd11d" status: 202 len: 0 microversion: 2.1 time: 0.114595 Apr 23 03:52:01 user devstack@n-api.service[61308]: [pid: 61308|app: 0|req: 85/250] 10.0.0.210 () {62 vars in 1325 bytes} [Sun Apr 23 03:52:01 2023] DELETE /compute/v2.1/os-volumes/130dcf61-3ca4-4e4d-be23-d73f877cd11d => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 23 03:52:01 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi [None req-bab7b55a-f452-4dbb-b556-dbadb8da1bc9 tempest-VolumesSnapshotsTestJSON-520656398 tempest-VolumesSnapshotsTestJSON-520656398-project-member] Calling method '.version_select at 0x7f21e12b0af0>' {{(pid=61306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 03:52:01 user devstack@n-api.service[61306]: INFO nova.api.openstack.wsgi [None req-bab7b55a-f452-4dbb-b556-dbadb8da1bc9 tempest-VolumesSnapshotsTestJSON-520656398 tempest-VolumesSnapshotsTestJSON-520656398-project-member] HTTP exception thrown: Volume 130dcf61-3ca4-4e4d-be23-d73f877cd11d could not be found. Apr 23 03:52:01 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi [None req-bab7b55a-f452-4dbb-b556-dbadb8da1bc9 tempest-VolumesSnapshotsTestJSON-520656398 tempest-VolumesSnapshotsTestJSON-520656398-project-member] Request method failure captured: Apr 23 03:52:01 user devstack@n-api.service[61306]: request: GET /compute/v2.1/os-volumes/130dcf61-3ca4-4e4d-be23-d73f877cd11d HTTP/1.1 Apr 23 03:52:01 user devstack@n-api.service[61306]: Accept: application/json Apr 23 03:52:01 user devstack@n-api.service[61306]: Accept-Encoding: identity Apr 23 03:52:01 user devstack@n-api.service[61306]: Connection: close Apr 23 03:52:01 user devstack@n-api.service[61306]: Content-Length: 0 Apr 23 03:52:01 user devstack@n-api.service[61306]: Content-Type: application/json Apr 23 03:52:01 user devstack@n-api.service[61306]: Host: 10.0.0.210 Apr 23 03:52:01 user devstack@n-api.service[61306]: Openstack-System-Scope: None Apr 23 03:52:01 user devstack@n-api.service[61306]: User-Agent: python-urllib3/1.26.15 Apr 23 03:52:01 user devstack@n-api.service[61306]: X-Auth-Token: gAAAAABkRKtfg4ULeMJtRnLSQKrQtYEvD6BHaCYbin7oCGefmNIxJpag-tQsGnxvc9vxOkM125G9tNvIOOBqwK4kR8e9aqzqs7KKBENw90wnXBbtkexZOL9Mfb_5fhVPSpj0vskXBHo9wSdnHhSS5Ta6tPsNrIWIfxffhCoUQM16ldAmNGHS4bI Apr 23 03:52:01 user devstack@n-api.service[61306]: X-Domain-Id: None Apr 23 03:52:01 user devstack@n-api.service[61306]: X-Domain-Name: None Apr 23 03:52:01 user devstack@n-api.service[61306]: X-Identity-Status: Confirmed Apr 23 03:52:01 user devstack@n-api.service[61306]: X-Is-Admin-Project: True Apr 23 03:52:01 user devstack@n-api.service[61306]: X-Project-Domain-Id: default Apr 23 03:52:01 user devstack@n-api.service[61306]: X-Project-Domain-Name: Default Apr 23 03:52:01 user devstack@n-api.service[61306]: X-Project-Id: f43ba97f709045d99f3895206fbb7552 Apr 23 03:52:01 user devstack@n-api.service[61306]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-520656398 Apr 23 03:52:01 user devstack@n-api.service[61306]: X-Role: reader,member Apr 23 03:52:01 user devstack@n-api.service[61306]: X-Roles: reader,member Apr 23 03:52:01 user devstack@n-api.service[61306]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f43ba97f709045d99f3895206fbb7552"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f43ba97f709045d99f3895206fbb7552"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f43ba97f709045d99f3895206fbb7552"}]}] Apr 23 03:52:01 user devstack@n-api.service[61306]: X-Tenant: tempest-VolumesSnapshotsTestJSON-520656398 Apr 23 03:52:01 user devstack@n-api.service[61306]: X-Tenant-Id: f43ba97f709045d99f3895206fbb7552 Apr 23 03:52:01 user devstack@n-api.service[61306]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-520656398 Apr 23 03:52:01 user devstack@n-api.service[61306]: X-User: tempest-VolumesSnapshotsTestJSON-520656398-project-member Apr 23 03:52:01 user devstack@n-api.service[61306]: X-User-Domain-Id: default Apr 23 03:52:01 user devstack@n-api.service[61306]: X-User-Domain-Name: Default Apr 23 03:52:01 user devstack@n-api.service[61306]: X-User-Id: 78c28a0da0134b7e9f5c42ec0f39b5b1 Apr 23 03:52:01 user devstack@n-api.service[61306]: X-User-Name: tempest-VolumesSnapshotsTestJSON-520656398-project-member Apr 23 03:52:01 user devstack@n-api.service[61306]: method: Apr 23 03:52:01 user devstack@n-api.service[61306]: exception: Volume 130dcf61-3ca4-4e4d-be23-d73f877cd11d could not be found. Apr 23 03:52:01 user devstack@n-api.service[61306]: action_args: {'id': '130dcf61-3ca4-4e4d-be23-d73f877cd11d'} Apr 23 03:52:01 user devstack@n-api.service[61306]: {{(pid=61306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 23 03:52:01 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 23 03:52:01 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 23 03:52:01 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 23 03:52:01 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 23 03:52:01 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 23 03:52:01 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 23 03:52:01 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 23 03:52:01 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 23 03:52:01 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 23 03:52:01 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 23 03:52:01 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 23 03:52:01 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 23 03:52:01 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 23 03:52:01 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 23 03:52:01 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 23 03:52:01 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 130dcf61-3ca4-4e4d-be23-d73f877cd11d could not be found. (HTTP 404) (Request-ID: req-ce364061-2626-4857-af57-c617b7576071) Apr 23 03:52:01 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi Apr 23 03:52:01 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 23 03:52:01 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi Apr 23 03:52:01 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 23 03:52:01 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 23 03:52:01 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 23 03:52:01 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 23 03:52:01 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 23 03:52:01 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 23 03:52:01 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 23 03:52:01 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 23 03:52:01 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 23 03:52:01 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 23 03:52:01 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 23 03:52:01 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 23 03:52:01 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 23 03:52:01 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 23 03:52:01 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 23 03:52:01 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 23 03:52:01 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 23 03:52:01 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 23 03:52:01 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 23 03:52:01 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 23 03:52:01 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 23 03:52:01 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 23 03:52:01 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 23 03:52:01 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 130dcf61-3ca4-4e4d-be23-d73f877cd11d could not be found. Apr 23 03:52:01 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi Apr 23 03:52:01 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 23 03:52:01 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi Apr 23 03:52:01 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 23 03:52:01 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 23 03:52:01 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 23 03:52:01 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 23 03:52:01 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 23 03:52:01 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 23 03:52:01 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 23 03:52:01 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 23 03:52:01 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 23 03:52:01 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 23 03:52:01 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 23 03:52:01 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 130dcf61-3ca4-4e4d-be23-d73f877cd11d could not be found. Apr 23 03:52:01 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi Apr 23 03:52:01 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 23 03:52:01 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi Apr 23 03:52:01 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 23 03:52:01 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 23 03:52:01 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 23 03:52:01 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 23 03:52:01 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 23 03:52:01 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 130dcf61-3ca4-4e4d-be23-d73f877cd11d could not be found. Apr 23 03:52:01 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi Apr 23 03:52:01 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi [None req-bab7b55a-f452-4dbb-b556-dbadb8da1bc9 tempest-VolumesSnapshotsTestJSON-520656398 tempest-VolumesSnapshotsTestJSON-520656398-project-member] Returning 404 to user: Volume 130dcf61-3ca4-4e4d-be23-d73f877cd11d could not be found. {{(pid=61306) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 23 03:52:01 user devstack@n-api.service[61306]: INFO nova.api.openstack.requestlog [None req-bab7b55a-f452-4dbb-b556-dbadb8da1bc9 tempest-VolumesSnapshotsTestJSON-520656398 tempest-VolumesSnapshotsTestJSON-520656398-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/130dcf61-3ca4-4e4d-be23-d73f877cd11d" status: 404 len: 109 microversion: 2.1 time: 0.044667 Apr 23 03:52:01 user devstack@n-api.service[61306]: [pid: 61306|app: 0|req: 83/251] 10.0.0.210 () {62 vars in 1322 bytes} [Sun Apr 23 03:52:01 2023] GET /compute/v2.1/os-volumes/130dcf61-3ca4-4e4d-be23-d73f877cd11d => generated 109 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 23 03:52:01 user devstack@n-api.service[61307]: DEBUG nova.policy [None req-8dba9e69-1a0a-4645-9dde-30215c3b07e5 tempest-VolumesAdminNegativeTest-594073230 tempest-VolumesAdminNegativeTest-594073230-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e80c354abd34bd3a28ddaeec9535af2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb0a03655cf4aa78e27c81ea4e1c424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61307) authorize /opt/stack/nova/nova/policy.py:203}} Apr 23 03:52:01 user devstack@n-api.service[61307]: INFO nova.api.openstack.requestlog [None req-8dba9e69-1a0a-4645-9dde-30215c3b07e5 tempest-VolumesAdminNegativeTest-594073230 tempest-VolumesAdminNegativeTest-594073230-project-member] 10.0.0.210 "GET /compute/v2.1/servers/91756f90-733e-4aa5-9108-d2d8b1d020fe" status: 200 len: 1669 microversion: 2.1 time: 0.260379 Apr 23 03:52:01 user devstack@n-api.service[61307]: [pid: 61307|app: 0|req: 84/252] 10.0.0.210 () {62 vars in 1313 bytes} [Sun Apr 23 03:52:01 2023] GET /compute/v2.1/servers/91756f90-733e-4aa5-9108-d2d8b1d020fe => generated 1669 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 23 03:52:01 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi [req-e33b5c73-888b-4650-89c9-6a795ebb459b req-a754cf2d-10df-4837-83be-6b03ffba19e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91756f90-733e-4aa5-9108-d2d8b1d020fe", "name": "network-vif-unplugged", "status": "completed", "tag": "b7f45c1f-8b9b-4d06-a389-d7643565e934"}]} {{(pid=61308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 03:52:01 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [req-e33b5c73-888b-4650-89c9-6a795ebb459b req-a754cf2d-10df-4837-83be-6b03ffba19e2 service nova] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:52:01 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [req-e33b5c73-888b-4650-89c9-6a795ebb459b req-a754cf2d-10df-4837-83be-6b03ffba19e2 service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:52:01 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [req-e33b5c73-888b-4650-89c9-6a795ebb459b req-a754cf2d-10df-4837-83be-6b03ffba19e2 service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:52:01 user devstack@n-api.service[61308]: INFO nova.api.openstack.compute.server_external_events [req-e33b5c73-888b-4650-89c9-6a795ebb459b req-a754cf2d-10df-4837-83be-6b03ffba19e2 service nova] Creating event network-vif-unplugged:b7f45c1f-8b9b-4d06-a389-d7643565e934 for instance 91756f90-733e-4aa5-9108-d2d8b1d020fe on user Apr 23 03:52:01 user devstack@n-api.service[61308]: INFO nova.api.openstack.requestlog [req-e33b5c73-888b-4650-89c9-6a795ebb459b req-a754cf2d-10df-4837-83be-6b03ffba19e2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.079545 Apr 23 03:52:01 user devstack@n-api.service[61308]: [pid: 61308|app: 0|req: 86/253] 10.0.0.210 () {68 vars in 1394 bytes} [Sun Apr 23 03:52:01 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 23 03:52:02 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi [req-bea8bc91-3c09-48cb-9a49-e90efc1200b1 req-9b6a6548-fbd7-442d-a762-68897c8be8c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c1f1f24-62f5-4e51-8c74-b5b89b6585a4", "name": "network-vif-deleted", "tag": "2a195833-5430-4cc1-a938-5b4157c32300"}, {"server_uuid": "7c1f1f24-62f5-4e51-8c74-b5b89b6585a4", "name": "network-vif-plugged", "status": "completed", "tag": "2a195833-5430-4cc1-a938-5b4157c32300"}]} {{(pid=61306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 03:52:02 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [req-bea8bc91-3c09-48cb-9a49-e90efc1200b1 req-9b6a6548-fbd7-442d-a762-68897c8be8c2 service nova] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:52:02 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [req-bea8bc91-3c09-48cb-9a49-e90efc1200b1 req-9b6a6548-fbd7-442d-a762-68897c8be8c2 service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:52:02 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [req-bea8bc91-3c09-48cb-9a49-e90efc1200b1 req-9b6a6548-fbd7-442d-a762-68897c8be8c2 service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:52:02 user devstack@n-api.service[61306]: INFO nova.api.openstack.compute.server_external_events [req-bea8bc91-3c09-48cb-9a49-e90efc1200b1 req-9b6a6548-fbd7-442d-a762-68897c8be8c2 service nova] Creating event network-vif-deleted:2a195833-5430-4cc1-a938-5b4157c32300 for instance 7c1f1f24-62f5-4e51-8c74-b5b89b6585a4 on user Apr 23 03:52:02 user devstack@n-api.service[61306]: INFO nova.api.openstack.compute.server_external_events [req-bea8bc91-3c09-48cb-9a49-e90efc1200b1 req-9b6a6548-fbd7-442d-a762-68897c8be8c2 service nova] Creating event network-vif-plugged:2a195833-5430-4cc1-a938-5b4157c32300 for instance 7c1f1f24-62f5-4e51-8c74-b5b89b6585a4 on user Apr 23 03:52:02 user devstack@n-api.service[61306]: INFO nova.api.openstack.requestlog [req-bea8bc91-3c09-48cb-9a49-e90efc1200b1 req-9b6a6548-fbd7-442d-a762-68897c8be8c2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.040770 Apr 23 03:52:02 user devstack@n-api.service[61306]: [pid: 61306|app: 0|req: 84/254] 10.0.0.210 () {68 vars in 1394 bytes} [Sun Apr 23 03:52:02 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 23 03:52:03 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi [req-8db4f709-8b62-4c9d-9efd-582ffd68bd6e req-1fe5f8a7-dc65-4a64-8975-9b64562fd597 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91756f90-733e-4aa5-9108-d2d8b1d020fe", "name": "network-vif-plugged", "status": "completed", "tag": "b7f45c1f-8b9b-4d06-a389-d7643565e934"}, {"server_uuid": "91756f90-733e-4aa5-9108-d2d8b1d020fe", "name": "network-vif-plugged", "status": "completed", "tag": "b7f45c1f-8b9b-4d06-a389-d7643565e934"}, {"server_uuid": "91756f90-733e-4aa5-9108-d2d8b1d020fe", "name": "network-vif-plugged", "status": "completed", "tag": "b7f45c1f-8b9b-4d06-a389-d7643565e934"}, {"server_uuid": "91756f90-733e-4aa5-9108-d2d8b1d020fe", "name": "network-vif-unplugged", "status": "completed", "tag": "b7f45c1f-8b9b-4d06-a389-d7643565e934"}, {"server_uuid": "91756f90-733e-4aa5-9108-d2d8b1d020fe", "name": "network-vif-plugged", "status": "completed", "tag": "b7f45c1f-8b9b-4d06-a389-d7643565e934"}]} {{(pid=61307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 03:52:03 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [req-8db4f709-8b62-4c9d-9efd-582ffd68bd6e req-1fe5f8a7-dc65-4a64-8975-9b64562fd597 service nova] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:52:03 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [req-8db4f709-8b62-4c9d-9efd-582ffd68bd6e req-1fe5f8a7-dc65-4a64-8975-9b64562fd597 service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:52:03 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [req-8db4f709-8b62-4c9d-9efd-582ffd68bd6e req-1fe5f8a7-dc65-4a64-8975-9b64562fd597 service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:52:03 user devstack@n-api.service[61307]: INFO nova.api.openstack.compute.server_external_events [req-8db4f709-8b62-4c9d-9efd-582ffd68bd6e req-1fe5f8a7-dc65-4a64-8975-9b64562fd597 service nova] Creating event network-vif-plugged:b7f45c1f-8b9b-4d06-a389-d7643565e934 for instance 91756f90-733e-4aa5-9108-d2d8b1d020fe on user Apr 23 03:52:03 user devstack@n-api.service[61307]: INFO nova.api.openstack.compute.server_external_events [req-8db4f709-8b62-4c9d-9efd-582ffd68bd6e req-1fe5f8a7-dc65-4a64-8975-9b64562fd597 service nova] Creating event network-vif-plugged:b7f45c1f-8b9b-4d06-a389-d7643565e934 for instance 91756f90-733e-4aa5-9108-d2d8b1d020fe on user Apr 23 03:52:03 user devstack@n-api.service[61307]: INFO nova.api.openstack.compute.server_external_events [req-8db4f709-8b62-4c9d-9efd-582ffd68bd6e req-1fe5f8a7-dc65-4a64-8975-9b64562fd597 service nova] Creating event network-vif-plugged:b7f45c1f-8b9b-4d06-a389-d7643565e934 for instance 91756f90-733e-4aa5-9108-d2d8b1d020fe on user Apr 23 03:52:03 user devstack@n-api.service[61307]: INFO nova.api.openstack.compute.server_external_events [req-8db4f709-8b62-4c9d-9efd-582ffd68bd6e req-1fe5f8a7-dc65-4a64-8975-9b64562fd597 service nova] Creating event network-vif-unplugged:b7f45c1f-8b9b-4d06-a389-d7643565e934 for instance 91756f90-733e-4aa5-9108-d2d8b1d020fe on user Apr 23 03:52:03 user devstack@n-api.service[61307]: INFO nova.api.openstack.compute.server_external_events [req-8db4f709-8b62-4c9d-9efd-582ffd68bd6e req-1fe5f8a7-dc65-4a64-8975-9b64562fd597 service nova] Creating event network-vif-plugged:b7f45c1f-8b9b-4d06-a389-d7643565e934 for instance 91756f90-733e-4aa5-9108-d2d8b1d020fe on user Apr 23 03:52:03 user devstack@n-api.service[61307]: INFO nova.api.openstack.requestlog [req-8db4f709-8b62-4c9d-9efd-582ffd68bd6e req-1fe5f8a7-dc65-4a64-8975-9b64562fd597 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 869 microversion: 2.1 time: 0.041240 Apr 23 03:52:03 user devstack@n-api.service[61307]: [pid: 61307|app: 0|req: 85/255] 10.0.0.210 () {68 vars in 1394 bytes} [Sun Apr 23 03:52:03 2023] POST /compute/v2.1/os-server-external-events => generated 869 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 23 03:52:04 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi [req-391da69a-4247-408b-b99c-cf10070218b1 req-2763b4b9-265e-400c-bd32-3e774579aafa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91756f90-733e-4aa5-9108-d2d8b1d020fe", "name": "network-vif-deleted", "tag": "b7f45c1f-8b9b-4d06-a389-d7643565e934"}]} {{(pid=61308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 03:52:04 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [req-391da69a-4247-408b-b99c-cf10070218b1 req-2763b4b9-265e-400c-bd32-3e774579aafa service nova] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:52:04 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [req-391da69a-4247-408b-b99c-cf10070218b1 req-2763b4b9-265e-400c-bd32-3e774579aafa service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:52:04 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [req-391da69a-4247-408b-b99c-cf10070218b1 req-2763b4b9-265e-400c-bd32-3e774579aafa service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:52:04 user devstack@n-api.service[61308]: INFO nova.api.openstack.compute.server_external_events [req-391da69a-4247-408b-b99c-cf10070218b1 req-2763b4b9-265e-400c-bd32-3e774579aafa service nova] Creating event network-vif-deleted:b7f45c1f-8b9b-4d06-a389-d7643565e934 for instance 91756f90-733e-4aa5-9108-d2d8b1d020fe on user Apr 23 03:52:04 user devstack@n-api.service[61308]: INFO nova.api.openstack.requestlog [req-391da69a-4247-408b-b99c-cf10070218b1 req-2763b4b9-265e-400c-bd32-3e774579aafa service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030940 Apr 23 03:52:04 user devstack@n-api.service[61308]: [pid: 61308|app: 0|req: 87/256] 10.0.0.210 () {68 vars in 1394 bytes} [Sun Apr 23 03:52:04 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 23 03:52:05 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi [None req-e6b88cf4-0fc3-4fe0-a9c7-d5c6d7961657 tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-1895964229", "imageRef": "e6127373-9931-4277-9458-eceef653ea1e", "flavorRef": "42", "block_device_mapping_v2": [{"boot_index": "0", "source_type": "blank", "volume_size": 1, "destination_type": "volume"}], "networks": [{"uuid": "25de9e6c-4c02-4658-b076-466681d96605"}]}} {{(pid=61306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 03:52:05 user devstack@n-api.service[61306]: DEBUG nova.network.neutron [None req-e6b88cf4-0fc3-4fe0-a9c7-d5c6d7961657 tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] validate_networks() for [('25de9e6c-4c02-4658-b076-466681d96605', None, None, None, None, None)] {{(pid=61306) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 23 03:52:06 user devstack@n-api.service[61306]: DEBUG nova.virt.hardware [None req-e6b88cf4-0fc3-4fe0-a9c7-d5c6d7961657 tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Flavor limits 0:0:0 {{(pid=61306) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 23 03:52:06 user devstack@n-api.service[61306]: DEBUG nova.virt.hardware [None req-e6b88cf4-0fc3-4fe0-a9c7-d5c6d7961657 tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Image limits 0:0:0 {{(pid=61306) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 23 03:52:06 user devstack@n-api.service[61306]: DEBUG nova.virt.hardware [None req-e6b88cf4-0fc3-4fe0-a9c7-d5c6d7961657 tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Flavor pref 0:0:0 {{(pid=61306) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 23 03:52:06 user devstack@n-api.service[61306]: DEBUG nova.virt.hardware [None req-e6b88cf4-0fc3-4fe0-a9c7-d5c6d7961657 tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Image pref 0:0:0 {{(pid=61306) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 23 03:52:06 user devstack@n-api.service[61306]: DEBUG nova.virt.hardware [None req-e6b88cf4-0fc3-4fe0-a9c7-d5c6d7961657 tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61306) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 23 03:52:06 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-e6b88cf4-0fc3-4fe0-a9c7-d5c6d7961657 tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:52:06 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-e6b88cf4-0fc3-4fe0-a9c7-d5c6d7961657 tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:52:06 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-e6b88cf4-0fc3-4fe0-a9c7-d5c6d7961657 tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:52:06 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-e6b88cf4-0fc3-4fe0-a9c7-d5c6d7961657 tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:52:06 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-e6b88cf4-0fc3-4fe0-a9c7-d5c6d7961657 tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:52:06 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-e6b88cf4-0fc3-4fe0-a9c7-d5c6d7961657 tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:52:06 user devstack@n-api.service[61306]: DEBUG nova.quota [None req-e6b88cf4-0fc3-4fe0-a9c7-d5c6d7961657 tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Getting quotas for project a79e09b1c4ae4cc5ab11c3e56ee4f0d9. Resources: {'ram', 'instances', 'cores'} {{(pid=61306) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 23 03:52:06 user devstack@n-api.service[61306]: DEBUG nova.quota [None req-e6b88cf4-0fc3-4fe0-a9c7-d5c6d7961657 tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Getting quotas for user 99495726467944c38620831fc93e2856 and project a79e09b1c4ae4cc5ab11c3e56ee4f0d9. Resources: {'ram', 'instances', 'cores'} {{(pid=61306) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 23 03:52:06 user devstack@n-api.service[61306]: DEBUG nova.compute.api [None req-e6b88cf4-0fc3-4fe0-a9c7-d5c6d7961657 tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Going to run 1 instances... {{(pid=61306) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 23 03:52:06 user devstack@n-api.service[61306]: DEBUG nova.compute.api [None req-e6b88cf4-0fc3-4fe0-a9c7-d5c6d7961657 tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] [instance: 01477cd2-cdb7-41e0-96d4-3aff879b3093] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=61306) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 23 03:52:06 user devstack@n-api.service[61306]: INFO nova.api.openstack.requestlog [None req-e6b88cf4-0fc3-4fe0-a9c7-d5c6d7961657 tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.722971 Apr 23 03:52:06 user devstack@n-api.service[61306]: [pid: 61306|app: 0|req: 85/257] 10.0.0.210 () {66 vars in 1265 bytes} [Sun Apr 23 03:52:05 2023] POST /compute/v2.1/servers => generated 378 bytes in 725 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 23 03:52:06 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi [None req-46fdb83d-41ee-4300-af63-ca56684c5cd7 tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Calling method '>' {{(pid=61307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 03:52:06 user devstack@n-api.service[61307]: DEBUG nova.compute.api [None req-46fdb83d-41ee-4300-af63-ca56684c5cd7 tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] [instance: 01477cd2-cdb7-41e0-96d4-3aff879b3093] Fetching instance by UUID {{(pid=61307) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 23 03:52:06 user devstack@n-api.service[61307]: DEBUG nova.policy [None req-46fdb83d-41ee-4300-af63-ca56684c5cd7 tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99495726467944c38620831fc93e2856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79e09b1c4ae4cc5ab11c3e56ee4f0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61307) authorize /opt/stack/nova/nova/policy.py:203}} Apr 23 03:52:06 user devstack@n-api.service[61307]: DEBUG nova.policy [None req-46fdb83d-41ee-4300-af63-ca56684c5cd7 tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99495726467944c38620831fc93e2856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79e09b1c4ae4cc5ab11c3e56ee4f0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61307) authorize /opt/stack/nova/nova/policy.py:203}} Apr 23 03:52:06 user devstack@n-api.service[61307]: DEBUG nova.policy [None req-46fdb83d-41ee-4300-af63-ca56684c5cd7 tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99495726467944c38620831fc93e2856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79e09b1c4ae4cc5ab11c3e56ee4f0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61307) authorize /opt/stack/nova/nova/policy.py:203}} Apr 23 03:52:06 user devstack@n-api.service[61307]: INFO nova.api.openstack.requestlog [None req-46fdb83d-41ee-4300-af63-ca56684c5cd7 tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] 10.0.0.210 "GET /compute/v2.1/servers/01477cd2-cdb7-41e0-96d4-3aff879b3093" status: 200 len: 1395 microversion: 2.87 time: 0.100221 Apr 23 03:52:06 user devstack@n-api.service[61307]: [pid: 61307|app: 0|req: 86/258] 10.0.0.210 () {64 vars in 1354 bytes} [Sun Apr 23 03:52:06 2023] GET /compute/v2.1/servers/01477cd2-cdb7-41e0-96d4-3aff879b3093 => generated 1395 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 23 03:52:09 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi [req-5dd76643-82c4-44e4-baa1-c0f8ab965bba req-de01149e-5475-439b-91f0-68203f3ec169 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01477cd2-cdb7-41e0-96d4-3aff879b3093", "tag": "277262c8-889d-4094-9836-f0d796d72230"}]} {{(pid=61308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 03:52:09 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [req-5dd76643-82c4-44e4-baa1-c0f8ab965bba req-de01149e-5475-439b-91f0-68203f3ec169 service nova] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:52:09 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [req-5dd76643-82c4-44e4-baa1-c0f8ab965bba req-de01149e-5475-439b-91f0-68203f3ec169 service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:52:09 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [req-5dd76643-82c4-44e4-baa1-c0f8ab965bba req-de01149e-5475-439b-91f0-68203f3ec169 service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:52:09 user devstack@n-api.service[61308]: INFO nova.api.openstack.compute.server_external_events [req-5dd76643-82c4-44e4-baa1-c0f8ab965bba req-de01149e-5475-439b-91f0-68203f3ec169 service nova] Creating event network-changed:277262c8-889d-4094-9836-f0d796d72230 for instance 01477cd2-cdb7-41e0-96d4-3aff879b3093 on user Apr 23 03:52:09 user devstack@n-api.service[61308]: INFO nova.api.openstack.requestlog [req-5dd76643-82c4-44e4-baa1-c0f8ab965bba req-de01149e-5475-439b-91f0-68203f3ec169 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036063 Apr 23 03:52:09 user devstack@n-api.service[61308]: [pid: 61308|app: 0|req: 88/259] 10.0.0.210 () {68 vars in 1394 bytes} [Sun Apr 23 03:52:09 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 23 03:52:12 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi [None req-33d3f7f8-cab7-47dd-af26-19cb4d040a92 tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] Calling method '>' {{(pid=61306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 03:52:12 user devstack@n-api.service[61306]: DEBUG nova.compute.api [None req-33d3f7f8-cab7-47dd-af26-19cb4d040a92 tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] [instance: 90cce4ec-f48c-408f-8d8f-46414bde01df] Fetching instance by UUID {{(pid=61306) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 23 03:52:12 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-33d3f7f8-cab7-47dd-af26-19cb4d040a92 tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:52:12 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-33d3f7f8-cab7-47dd-af26-19cb4d040a92 tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:52:12 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-33d3f7f8-cab7-47dd-af26-19cb4d040a92 tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:52:12 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-33d3f7f8-cab7-47dd-af26-19cb4d040a92 tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:52:12 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-33d3f7f8-cab7-47dd-af26-19cb4d040a92 tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:52:12 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-33d3f7f8-cab7-47dd-af26-19cb4d040a92 tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:52:12 user devstack@n-api.service[61306]: DEBUG nova.policy [None req-33d3f7f8-cab7-47dd-af26-19cb4d040a92 tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93a8dbfd8cef4578aff742813ffe901e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab0f01751954d04a83b360b2f839716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61306) authorize /opt/stack/nova/nova/policy.py:203}} Apr 23 03:52:12 user devstack@n-api.service[61306]: INFO nova.api.openstack.requestlog [None req-33d3f7f8-cab7-47dd-af26-19cb4d040a92 tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] 10.0.0.210 "GET /compute/v2.1/servers/90cce4ec-f48c-408f-8d8f-46414bde01df" status: 200 len: 1535 microversion: 2.1 time: 0.227338 Apr 23 03:52:12 user devstack@n-api.service[61306]: [pid: 61306|app: 0|req: 86/260] 10.0.0.210 () {62 vars in 1313 bytes} [Sun Apr 23 03:52:12 2023] GET /compute/v2.1/servers/90cce4ec-f48c-408f-8d8f-46414bde01df => generated 1535 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 23 03:52:12 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi [None req-736765d2-959d-462e-8cc5-42e51cb510aa tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] Calling method '>' {{(pid=61307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 03:52:12 user devstack@n-api.service[61307]: DEBUG nova.policy [None req-736765d2-959d-462e-8cc5-42e51cb510aa tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '93a8dbfd8cef4578aff742813ffe901e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab0f01751954d04a83b360b2f839716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61307) authorize /opt/stack/nova/nova/policy.py:203}} Apr 23 03:52:12 user devstack@n-api.service[61307]: DEBUG nova.compute.api [None req-736765d2-959d-462e-8cc5-42e51cb510aa tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] Searching by: {'deleted': False, 'project_id': '8ab0f01751954d04a83b360b2f839716'} {{(pid=61307) get_all /opt/stack/nova/nova/compute/api.py:3019}} Apr 23 03:52:12 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-736765d2-959d-462e-8cc5-42e51cb510aa tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:52:12 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-736765d2-959d-462e-8cc5-42e51cb510aa tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:52:12 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-736765d2-959d-462e-8cc5-42e51cb510aa tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:52:12 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-736765d2-959d-462e-8cc5-42e51cb510aa tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:52:12 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-736765d2-959d-462e-8cc5-42e51cb510aa tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:52:12 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-736765d2-959d-462e-8cc5-42e51cb510aa tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:52:12 user devstack@n-api.service[61307]: DEBUG nova.compute.multi_cell_list [None req-736765d2-959d-462e-8cc5-42e51cb510aa tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=61307) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 23 03:52:12 user devstack@n-api.service[61307]: INFO nova.api.openstack.requestlog [None req-736765d2-959d-462e-8cc5-42e51cb510aa tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] 10.0.0.210 "GET /compute/v2.1/servers" status: 200 len: 340 microversion: 2.1 time: 0.213604 Apr 23 03:52:12 user devstack@n-api.service[61307]: [pid: 61307|app: 0|req: 87/261] 10.0.0.210 () {62 vars in 1202 bytes} [Sun Apr 23 03:52:12 2023] GET /compute/v2.1/servers => generated 340 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 23 03:52:12 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi [None req-a0d2508c-73a5-48fe-b5f3-c5713ae950ac tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] Calling method '>' {{(pid=61308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 03:52:12 user devstack@n-api.service[61308]: DEBUG nova.compute.api [None req-a0d2508c-73a5-48fe-b5f3-c5713ae950ac tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] [instance: 90cce4ec-f48c-408f-8d8f-46414bde01df] Fetching instance by UUID {{(pid=61308) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 23 03:52:12 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-a0d2508c-73a5-48fe-b5f3-c5713ae950ac tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:52:12 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-a0d2508c-73a5-48fe-b5f3-c5713ae950ac tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:52:12 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-a0d2508c-73a5-48fe-b5f3-c5713ae950ac tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:52:12 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-a0d2508c-73a5-48fe-b5f3-c5713ae950ac tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:52:12 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-a0d2508c-73a5-48fe-b5f3-c5713ae950ac tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:52:12 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-a0d2508c-73a5-48fe-b5f3-c5713ae950ac tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:52:12 user devstack@n-api.service[61308]: DEBUG nova.policy [None req-a0d2508c-73a5-48fe-b5f3-c5713ae950ac tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93a8dbfd8cef4578aff742813ffe901e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab0f01751954d04a83b360b2f839716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61308) authorize /opt/stack/nova/nova/policy.py:203}} Apr 23 03:52:12 user devstack@n-api.service[61308]: INFO nova.api.openstack.requestlog [None req-a0d2508c-73a5-48fe-b5f3-c5713ae950ac tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] 10.0.0.210 "GET /compute/v2.1/servers/90cce4ec-f48c-408f-8d8f-46414bde01df" status: 200 len: 1535 microversion: 2.1 time: 0.303135 Apr 23 03:52:12 user devstack@n-api.service[61308]: [pid: 61308|app: 0|req: 89/262] 10.0.0.210 () {62 vars in 1313 bytes} [Sun Apr 23 03:52:12 2023] GET /compute/v2.1/servers/90cce4ec-f48c-408f-8d8f-46414bde01df => generated 1535 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 23 03:52:14 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi [None req-cd036554-a33b-4636-b764-9434d2013eb4 tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] Calling method '>' {{(pid=61306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 03:52:14 user devstack@n-api.service[61306]: DEBUG nova.compute.api [None req-cd036554-a33b-4636-b764-9434d2013eb4 tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] [instance: 954f41b2-5c67-41a4-b38b-ebf3ad60cac7] Fetching instance by UUID {{(pid=61306) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 23 03:52:14 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-cd036554-a33b-4636-b764-9434d2013eb4 tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:52:14 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-cd036554-a33b-4636-b764-9434d2013eb4 tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:52:14 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-cd036554-a33b-4636-b764-9434d2013eb4 tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:52:14 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-cd036554-a33b-4636-b764-9434d2013eb4 tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:52:14 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-cd036554-a33b-4636-b764-9434d2013eb4 tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:52:14 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-cd036554-a33b-4636-b764-9434d2013eb4 tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:52:14 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi [None req-c1d74b78-c254-4d71-b634-27382b03030a tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] Calling method '>' {{(pid=61307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 03:52:14 user devstack@n-api.service[61307]: DEBUG nova.compute.api [None req-c1d74b78-c254-4d71-b634-27382b03030a tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] [instance: 90cce4ec-f48c-408f-8d8f-46414bde01df] Fetching instance by UUID {{(pid=61307) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 23 03:52:14 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-c1d74b78-c254-4d71-b634-27382b03030a tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:52:14 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-c1d74b78-c254-4d71-b634-27382b03030a tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:52:14 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-c1d74b78-c254-4d71-b634-27382b03030a tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:52:14 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-c1d74b78-c254-4d71-b634-27382b03030a tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:52:14 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-c1d74b78-c254-4d71-b634-27382b03030a tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:52:14 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-c1d74b78-c254-4d71-b634-27382b03030a tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:52:14 user devstack@n-api.service[61307]: DEBUG nova.compute.api [None req-c1d74b78-c254-4d71-b634-27382b03030a tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] [instance: 90cce4ec-f48c-408f-8d8f-46414bde01df] Going to try to terminate instance {{(pid=61307) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 23 03:52:14 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi [req-f808dfd2-7743-4ec6-8a1b-3bf86b168c6b req-783f10d4-9a74-46d4-822e-1966cb379e11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01477cd2-cdb7-41e0-96d4-3aff879b3093", "name": "network-vif-deleted", "tag": "277262c8-889d-4094-9836-f0d796d72230"}]} {{(pid=61308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 03:52:14 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [req-f808dfd2-7743-4ec6-8a1b-3bf86b168c6b req-783f10d4-9a74-46d4-822e-1966cb379e11 service nova] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:52:14 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [req-f808dfd2-7743-4ec6-8a1b-3bf86b168c6b req-783f10d4-9a74-46d4-822e-1966cb379e11 service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:52:14 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [req-f808dfd2-7743-4ec6-8a1b-3bf86b168c6b req-783f10d4-9a74-46d4-822e-1966cb379e11 service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:52:14 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.compute.server_external_events [req-f808dfd2-7743-4ec6-8a1b-3bf86b168c6b req-783f10d4-9a74-46d4-822e-1966cb379e11 service nova] Unable to find a host for instance 01477cd2-cdb7-41e0-96d4-3aff879b3093. Dropping event network-vif-deleted {{(pid=61308) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Apr 23 03:52:14 user devstack@n-api.service[61308]: INFO nova.api.openstack.requestlog [req-f808dfd2-7743-4ec6-8a1b-3bf86b168c6b req-783f10d4-9a74-46d4-822e-1966cb379e11 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.044706 Apr 23 03:52:14 user devstack@n-api.service[61308]: [pid: 61308|app: 0|req: 90/263] 10.0.0.210 () {68 vars in 1394 bytes} [Sun Apr 23 03:52:14 2023] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 47 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Apr 23 03:52:14 user devstack@n-api.service[61307]: INFO nova.api.openstack.requestlog [None req-c1d74b78-c254-4d71-b634-27382b03030a tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/90cce4ec-f48c-408f-8d8f-46414bde01df" status: 204 len: 0 microversion: 2.1 time: 0.145291 Apr 23 03:52:14 user devstack@n-api.service[61307]: [pid: 61307|app: 0|req: 88/264] 10.0.0.210 () {62 vars in 1316 bytes} [Sun Apr 23 03:52:14 2023] DELETE /compute/v2.1/servers/90cce4ec-f48c-408f-8d8f-46414bde01df => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 23 03:52:14 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi [None req-fa3616e1-190f-4ee5-839b-ee941b88ec4e tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] Calling method '>' {{(pid=61308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 03:52:14 user devstack@n-api.service[61308]: DEBUG nova.compute.api [None req-fa3616e1-190f-4ee5-839b-ee941b88ec4e tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] [instance: 90cce4ec-f48c-408f-8d8f-46414bde01df] Fetching instance by UUID {{(pid=61308) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 23 03:52:14 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-fa3616e1-190f-4ee5-839b-ee941b88ec4e tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:52:14 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-fa3616e1-190f-4ee5-839b-ee941b88ec4e tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:52:14 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-fa3616e1-190f-4ee5-839b-ee941b88ec4e tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:52:14 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-fa3616e1-190f-4ee5-839b-ee941b88ec4e tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:52:14 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-fa3616e1-190f-4ee5-839b-ee941b88ec4e tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:52:14 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-fa3616e1-190f-4ee5-839b-ee941b88ec4e tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:52:14 user devstack@n-api.service[61306]: DEBUG nova.policy [None req-cd036554-a33b-4636-b764-9434d2013eb4 tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdc8fe94058c46c28d4b3f16dc1e77ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f44fe9ba07e4e2f925d1a8952356e04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61306) authorize /opt/stack/nova/nova/policy.py:203}} Apr 23 03:52:14 user devstack@n-api.service[61306]: INFO nova.api.openstack.requestlog [None req-cd036554-a33b-4636-b764-9434d2013eb4 tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] 10.0.0.210 "GET /compute/v2.1/servers/954f41b2-5c67-41a4-b38b-ebf3ad60cac7" status: 200 len: 1658 microversion: 2.1 time: 0.263379 Apr 23 03:52:14 user devstack@n-api.service[61306]: [pid: 61306|app: 0|req: 87/265] 10.0.0.210 () {62 vars in 1313 bytes} [Sun Apr 23 03:52:14 2023] GET /compute/v2.1/servers/954f41b2-5c67-41a4-b38b-ebf3ad60cac7 => generated 1658 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 23 03:52:14 user devstack@n-api.service[61308]: DEBUG nova.policy [None req-fa3616e1-190f-4ee5-839b-ee941b88ec4e tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93a8dbfd8cef4578aff742813ffe901e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab0f01751954d04a83b360b2f839716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61308) authorize /opt/stack/nova/nova/policy.py:203}} Apr 23 03:52:14 user devstack@n-api.service[61308]: INFO nova.api.openstack.requestlog [None req-fa3616e1-190f-4ee5-839b-ee941b88ec4e tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] 10.0.0.210 "GET /compute/v2.1/servers/90cce4ec-f48c-408f-8d8f-46414bde01df" status: 200 len: 1541 microversion: 2.1 time: 0.199611 Apr 23 03:52:14 user devstack@n-api.service[61308]: [pid: 61308|app: 0|req: 91/266] 10.0.0.210 () {62 vars in 1313 bytes} [Sun Apr 23 03:52:14 2023] GET /compute/v2.1/servers/90cce4ec-f48c-408f-8d8f-46414bde01df => generated 1541 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 23 03:52:14 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi [req-6afe64c2-8dd5-4fb4-9f7b-9d5f527d777f req-35ccd24f-1453-4cf4-8a57-6b9a8f7be9af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90cce4ec-f48c-408f-8d8f-46414bde01df", "name": "network-vif-unplugged", "status": "completed", "tag": "c9e332a6-c2c7-41d3-9646-e5f672d8cb95"}]} {{(pid=61307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 03:52:14 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [req-6afe64c2-8dd5-4fb4-9f7b-9d5f527d777f req-35ccd24f-1453-4cf4-8a57-6b9a8f7be9af service nova] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:52:14 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [req-6afe64c2-8dd5-4fb4-9f7b-9d5f527d777f req-35ccd24f-1453-4cf4-8a57-6b9a8f7be9af service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:52:14 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [req-6afe64c2-8dd5-4fb4-9f7b-9d5f527d777f req-35ccd24f-1453-4cf4-8a57-6b9a8f7be9af service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:52:14 user devstack@n-api.service[61307]: INFO nova.api.openstack.compute.server_external_events [req-6afe64c2-8dd5-4fb4-9f7b-9d5f527d777f req-35ccd24f-1453-4cf4-8a57-6b9a8f7be9af service nova] Creating event network-vif-unplugged:c9e332a6-c2c7-41d3-9646-e5f672d8cb95 for instance 90cce4ec-f48c-408f-8d8f-46414bde01df on user Apr 23 03:52:14 user devstack@n-api.service[61307]: INFO nova.api.openstack.requestlog [req-6afe64c2-8dd5-4fb4-9f7b-9d5f527d777f req-35ccd24f-1453-4cf4-8a57-6b9a8f7be9af service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031577 Apr 23 03:52:14 user devstack@n-api.service[61307]: [pid: 61307|app: 0|req: 89/267] 10.0.0.210 () {68 vars in 1394 bytes} [Sun Apr 23 03:52:14 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 23 03:52:15 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi [None req-540910f9-ac4d-4ce2-b497-db34a0f9be61 tempest-VolumesActionsTest-911298328 tempest-VolumesActionsTest-911298328-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1320327354", "imageRef": "e6127373-9931-4277-9458-eceef653ea1e", "flavorRef": "42", "networks": [{"uuid": "b6746973-374e-4be6-9067-1f3d7424fe1d"}]}} {{(pid=61306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 03:52:15 user devstack@n-api.service[61306]: DEBUG nova.network.neutron [None req-540910f9-ac4d-4ce2-b497-db34a0f9be61 tempest-VolumesActionsTest-911298328 tempest-VolumesActionsTest-911298328-project-member] validate_networks() for [('b6746973-374e-4be6-9067-1f3d7424fe1d', None, None, None, None, None)] {{(pid=61306) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 23 03:52:15 user devstack@n-api.service[61306]: DEBUG nova.virt.hardware [None req-540910f9-ac4d-4ce2-b497-db34a0f9be61 tempest-VolumesActionsTest-911298328 tempest-VolumesActionsTest-911298328-project-member] Flavor limits 0:0:0 {{(pid=61306) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 23 03:52:15 user devstack@n-api.service[61306]: DEBUG nova.virt.hardware [None req-540910f9-ac4d-4ce2-b497-db34a0f9be61 tempest-VolumesActionsTest-911298328 tempest-VolumesActionsTest-911298328-project-member] Image limits 0:0:0 {{(pid=61306) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 23 03:52:15 user devstack@n-api.service[61306]: DEBUG nova.virt.hardware [None req-540910f9-ac4d-4ce2-b497-db34a0f9be61 tempest-VolumesActionsTest-911298328 tempest-VolumesActionsTest-911298328-project-member] Flavor pref 0:0:0 {{(pid=61306) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 23 03:52:15 user devstack@n-api.service[61306]: DEBUG nova.virt.hardware [None req-540910f9-ac4d-4ce2-b497-db34a0f9be61 tempest-VolumesActionsTest-911298328 tempest-VolumesActionsTest-911298328-project-member] Image pref 0:0:0 {{(pid=61306) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 23 03:52:15 user devstack@n-api.service[61306]: DEBUG nova.virt.hardware [None req-540910f9-ac4d-4ce2-b497-db34a0f9be61 tempest-VolumesActionsTest-911298328 tempest-VolumesActionsTest-911298328-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61306) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 23 03:52:15 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-540910f9-ac4d-4ce2-b497-db34a0f9be61 tempest-VolumesActionsTest-911298328 tempest-VolumesActionsTest-911298328-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:52:15 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-540910f9-ac4d-4ce2-b497-db34a0f9be61 tempest-VolumesActionsTest-911298328 tempest-VolumesActionsTest-911298328-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:52:15 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-540910f9-ac4d-4ce2-b497-db34a0f9be61 tempest-VolumesActionsTest-911298328 tempest-VolumesActionsTest-911298328-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:52:15 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-540910f9-ac4d-4ce2-b497-db34a0f9be61 tempest-VolumesActionsTest-911298328 tempest-VolumesActionsTest-911298328-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:52:15 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-540910f9-ac4d-4ce2-b497-db34a0f9be61 tempest-VolumesActionsTest-911298328 tempest-VolumesActionsTest-911298328-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:52:15 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-540910f9-ac4d-4ce2-b497-db34a0f9be61 tempest-VolumesActionsTest-911298328 tempest-VolumesActionsTest-911298328-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:52:15 user devstack@n-api.service[61306]: DEBUG nova.quota [None req-540910f9-ac4d-4ce2-b497-db34a0f9be61 tempest-VolumesActionsTest-911298328 tempest-VolumesActionsTest-911298328-project-member] Getting quotas for project 037d3963711a4727a4def98cfff4da67. Resources: {'ram', 'instances', 'cores'} {{(pid=61306) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 23 03:52:15 user devstack@n-api.service[61306]: DEBUG nova.quota [None req-540910f9-ac4d-4ce2-b497-db34a0f9be61 tempest-VolumesActionsTest-911298328 tempest-VolumesActionsTest-911298328-project-member] Getting quotas for user 405152a49bf14ad68f5c96f767c70b3a and project 037d3963711a4727a4def98cfff4da67. Resources: {'ram', 'instances', 'cores'} {{(pid=61306) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 23 03:52:15 user devstack@n-api.service[61306]: DEBUG nova.compute.api [None req-540910f9-ac4d-4ce2-b497-db34a0f9be61 tempest-VolumesActionsTest-911298328 tempest-VolumesActionsTest-911298328-project-member] Going to run 1 instances... {{(pid=61306) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 23 03:52:15 user devstack@n-api.service[61306]: DEBUG nova.compute.api [None req-540910f9-ac4d-4ce2-b497-db34a0f9be61 tempest-VolumesActionsTest-911298328 tempest-VolumesActionsTest-911298328-project-member] [instance: 39775e82-0123-41cf-ad97-d3865a796828] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e6127373-9931-4277-9458-eceef653ea1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61306) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 23 03:52:15 user devstack@n-api.service[61306]: INFO nova.api.openstack.requestlog [None req-540910f9-ac4d-4ce2-b497-db34a0f9be61 tempest-VolumesActionsTest-911298328 tempest-VolumesActionsTest-911298328-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.897639 Apr 23 03:52:15 user devstack@n-api.service[61306]: [pid: 61306|app: 0|req: 88/268] 10.0.0.210 () {64 vars in 1224 bytes} [Sun Apr 23 03:52:14 2023] POST /compute/v2.1/servers => generated 378 bytes in 899 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 23 03:52:15 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi [None req-d0f525f7-7dcf-4a2a-a332-d169afc6a83a tempest-VolumesActionsTest-911298328 tempest-VolumesActionsTest-911298328-project-member] Calling method '>' {{(pid=61308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 03:52:15 user devstack@n-api.service[61308]: DEBUG nova.compute.api [None req-d0f525f7-7dcf-4a2a-a332-d169afc6a83a tempest-VolumesActionsTest-911298328 tempest-VolumesActionsTest-911298328-project-member] [instance: 39775e82-0123-41cf-ad97-d3865a796828] Fetching instance by UUID {{(pid=61308) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 23 03:52:15 user devstack@n-api.service[61308]: DEBUG nova.policy [None req-d0f525f7-7dcf-4a2a-a332-d169afc6a83a tempest-VolumesActionsTest-911298328 tempest-VolumesActionsTest-911298328-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405152a49bf14ad68f5c96f767c70b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '037d3963711a4727a4def98cfff4da67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61308) authorize /opt/stack/nova/nova/policy.py:203}} Apr 23 03:52:15 user devstack@n-api.service[61308]: INFO nova.api.openstack.requestlog [None req-d0f525f7-7dcf-4a2a-a332-d169afc6a83a tempest-VolumesActionsTest-911298328 tempest-VolumesActionsTest-911298328-project-member] 10.0.0.210 "GET /compute/v2.1/servers/39775e82-0123-41cf-ad97-d3865a796828" status: 200 len: 1208 microversion: 2.1 time: 0.094338 Apr 23 03:52:15 user devstack@n-api.service[61308]: [pid: 61308|app: 0|req: 92/269] 10.0.0.210 () {62 vars in 1313 bytes} [Sun Apr 23 03:52:15 2023] GET /compute/v2.1/servers/39775e82-0123-41cf-ad97-d3865a796828 => generated 1208 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 23 03:52:16 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi [req-62f96328-d16d-4e06-9b19-d7215266aba7 req-2e5261ea-6d78-4d68-a667-1f0baa3215e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90cce4ec-f48c-408f-8d8f-46414bde01df", "name": "network-vif-deleted", "tag": "c9e332a6-c2c7-41d3-9646-e5f672d8cb95"}]} {{(pid=61307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 03:52:16 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [req-62f96328-d16d-4e06-9b19-d7215266aba7 req-2e5261ea-6d78-4d68-a667-1f0baa3215e4 service nova] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:52:16 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [req-62f96328-d16d-4e06-9b19-d7215266aba7 req-2e5261ea-6d78-4d68-a667-1f0baa3215e4 service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:52:16 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [req-62f96328-d16d-4e06-9b19-d7215266aba7 req-2e5261ea-6d78-4d68-a667-1f0baa3215e4 service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:52:16 user devstack@n-api.service[61307]: INFO nova.api.openstack.compute.server_external_events [req-62f96328-d16d-4e06-9b19-d7215266aba7 req-2e5261ea-6d78-4d68-a667-1f0baa3215e4 service nova] Creating event network-vif-deleted:c9e332a6-c2c7-41d3-9646-e5f672d8cb95 for instance 90cce4ec-f48c-408f-8d8f-46414bde01df on user Apr 23 03:52:16 user devstack@n-api.service[61307]: INFO nova.api.openstack.requestlog [req-62f96328-d16d-4e06-9b19-d7215266aba7 req-2e5261ea-6d78-4d68-a667-1f0baa3215e4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029687 Apr 23 03:52:16 user devstack@n-api.service[61307]: [pid: 61307|app: 0|req: 90/270] 10.0.0.210 () {68 vars in 1394 bytes} [Sun Apr 23 03:52:16 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 23 03:52:16 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi [req-5dcf805d-abb1-4964-9340-1c18cf4fca34 req-d836b67d-c59b-4dd6-a3f5-bd108d8308cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90cce4ec-f48c-408f-8d8f-46414bde01df", "name": "network-vif-plugged", "status": "completed", "tag": "c9e332a6-c2c7-41d3-9646-e5f672d8cb95"}, {"server_uuid": "90cce4ec-f48c-408f-8d8f-46414bde01df", "name": "network-vif-plugged", "status": "completed", "tag": "c9e332a6-c2c7-41d3-9646-e5f672d8cb95"}, {"server_uuid": "90cce4ec-f48c-408f-8d8f-46414bde01df", "name": "network-vif-plugged", "status": "completed", "tag": "c9e332a6-c2c7-41d3-9646-e5f672d8cb95"}, {"server_uuid": "90cce4ec-f48c-408f-8d8f-46414bde01df", "name": "network-vif-plugged", "status": "completed", "tag": "c9e332a6-c2c7-41d3-9646-e5f672d8cb95"}]} {{(pid=61306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 03:52:16 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [req-5dcf805d-abb1-4964-9340-1c18cf4fca34 req-d836b67d-c59b-4dd6-a3f5-bd108d8308cc service nova] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:52:16 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [req-5dcf805d-abb1-4964-9340-1c18cf4fca34 req-d836b67d-c59b-4dd6-a3f5-bd108d8308cc service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:52:16 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [req-5dcf805d-abb1-4964-9340-1c18cf4fca34 req-d836b67d-c59b-4dd6-a3f5-bd108d8308cc service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:52:16 user devstack@n-api.service[61306]: INFO nova.api.openstack.compute.server_external_events [req-5dcf805d-abb1-4964-9340-1c18cf4fca34 req-d836b67d-c59b-4dd6-a3f5-bd108d8308cc service nova] Creating event network-vif-plugged:c9e332a6-c2c7-41d3-9646-e5f672d8cb95 for instance 90cce4ec-f48c-408f-8d8f-46414bde01df on user Apr 23 03:52:16 user devstack@n-api.service[61306]: INFO nova.api.openstack.compute.server_external_events [req-5dcf805d-abb1-4964-9340-1c18cf4fca34 req-d836b67d-c59b-4dd6-a3f5-bd108d8308cc service nova] Creating event network-vif-plugged:c9e332a6-c2c7-41d3-9646-e5f672d8cb95 for instance 90cce4ec-f48c-408f-8d8f-46414bde01df on user Apr 23 03:52:16 user devstack@n-api.service[61306]: INFO nova.api.openstack.compute.server_external_events [req-5dcf805d-abb1-4964-9340-1c18cf4fca34 req-d836b67d-c59b-4dd6-a3f5-bd108d8308cc service nova] Creating event network-vif-plugged:c9e332a6-c2c7-41d3-9646-e5f672d8cb95 for instance 90cce4ec-f48c-408f-8d8f-46414bde01df on user Apr 23 03:52:16 user devstack@n-api.service[61306]: INFO nova.api.openstack.compute.server_external_events [req-5dcf805d-abb1-4964-9340-1c18cf4fca34 req-d836b67d-c59b-4dd6-a3f5-bd108d8308cc service nova] Creating event network-vif-plugged:c9e332a6-c2c7-41d3-9646-e5f672d8cb95 for instance 90cce4ec-f48c-408f-8d8f-46414bde01df on user Apr 23 03:52:16 user devstack@n-api.service[61306]: INFO nova.api.openstack.requestlog [req-5dcf805d-abb1-4964-9340-1c18cf4fca34 req-d836b67d-c59b-4dd6-a3f5-bd108d8308cc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.029240 Apr 23 03:52:16 user devstack@n-api.service[61306]: [pid: 61306|app: 0|req: 89/271] 10.0.0.210 () {68 vars in 1394 bytes} [Sun Apr 23 03:52:16 2023] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 23 03:52:19 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi [req-e581d466-eb41-4e7a-b2ab-153aa340f93a req-5aef251f-6b35-41d1-80ee-123eba4195ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39775e82-0123-41cf-ad97-d3865a796828", "tag": "83fd1d96-1b09-4965-9a3b-a362e9ffc06e"}]} {{(pid=61308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 03:52:19 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [req-e581d466-eb41-4e7a-b2ab-153aa340f93a req-5aef251f-6b35-41d1-80ee-123eba4195ee service nova] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:52:19 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [req-e581d466-eb41-4e7a-b2ab-153aa340f93a req-5aef251f-6b35-41d1-80ee-123eba4195ee service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:52:19 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [req-e581d466-eb41-4e7a-b2ab-153aa340f93a req-5aef251f-6b35-41d1-80ee-123eba4195ee service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:52:19 user devstack@n-api.service[61308]: INFO nova.api.openstack.compute.server_external_events [req-e581d466-eb41-4e7a-b2ab-153aa340f93a req-5aef251f-6b35-41d1-80ee-123eba4195ee service nova] Creating event network-changed:83fd1d96-1b09-4965-9a3b-a362e9ffc06e for instance 39775e82-0123-41cf-ad97-d3865a796828 on user Apr 23 03:52:19 user devstack@n-api.service[61308]: INFO nova.api.openstack.requestlog [req-e581d466-eb41-4e7a-b2ab-153aa340f93a req-5aef251f-6b35-41d1-80ee-123eba4195ee service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032490 Apr 23 03:52:19 user devstack@n-api.service[61308]: [pid: 61308|app: 0|req: 93/272] 10.0.0.210 () {68 vars in 1394 bytes} [Sun Apr 23 03:52:19 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 23 03:52:21 user devstack@n-api.service[61307]: DEBUG dbcounter [-] [61307] Writing DB stats nova_cell0:SELECT=2 {{(pid=61307) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:52:21 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi [req-6e2afdcd-e107-47b1-838e-90d2dc2ffb1b req-18451572-65ee-477a-8621-53366ba8f5f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39775e82-0123-41cf-ad97-d3865a796828", "name": "network-vif-plugged", "status": "completed", "tag": "83fd1d96-1b09-4965-9a3b-a362e9ffc06e"}]} {{(pid=61307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 03:52:21 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [req-6e2afdcd-e107-47b1-838e-90d2dc2ffb1b req-18451572-65ee-477a-8621-53366ba8f5f2 service nova] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:52:21 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [req-6e2afdcd-e107-47b1-838e-90d2dc2ffb1b req-18451572-65ee-477a-8621-53366ba8f5f2 service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:52:21 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [req-6e2afdcd-e107-47b1-838e-90d2dc2ffb1b req-18451572-65ee-477a-8621-53366ba8f5f2 service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:52:21 user devstack@n-api.service[61307]: INFO nova.api.openstack.compute.server_external_events [req-6e2afdcd-e107-47b1-838e-90d2dc2ffb1b req-18451572-65ee-477a-8621-53366ba8f5f2 service nova] Creating event network-vif-plugged:83fd1d96-1b09-4965-9a3b-a362e9ffc06e for instance 39775e82-0123-41cf-ad97-d3865a796828 on user Apr 23 03:52:21 user devstack@n-api.service[61307]: INFO nova.api.openstack.requestlog [req-6e2afdcd-e107-47b1-838e-90d2dc2ffb1b req-18451572-65ee-477a-8621-53366ba8f5f2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029467 Apr 23 03:52:21 user devstack@n-api.service[61307]: [pid: 61307|app: 0|req: 91/273] 10.0.0.210 () {68 vars in 1394 bytes} [Sun Apr 23 03:52:21 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 23 03:52:23 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi [req-0183b798-c888-4367-8e4f-c4c873cca202 req-63b312cc-da1b-4f2e-af2a-2e5266d16db7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39775e82-0123-41cf-ad97-d3865a796828", "name": "network-vif-plugged", "status": "completed", "tag": "83fd1d96-1b09-4965-9a3b-a362e9ffc06e"}]} {{(pid=61306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 03:52:23 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [req-0183b798-c888-4367-8e4f-c4c873cca202 req-63b312cc-da1b-4f2e-af2a-2e5266d16db7 service nova] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:52:23 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [req-0183b798-c888-4367-8e4f-c4c873cca202 req-63b312cc-da1b-4f2e-af2a-2e5266d16db7 service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:52:23 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [req-0183b798-c888-4367-8e4f-c4c873cca202 req-63b312cc-da1b-4f2e-af2a-2e5266d16db7 service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:52:23 user devstack@n-api.service[61306]: INFO nova.api.openstack.compute.server_external_events [req-0183b798-c888-4367-8e4f-c4c873cca202 req-63b312cc-da1b-4f2e-af2a-2e5266d16db7 service nova] Creating event network-vif-plugged:83fd1d96-1b09-4965-9a3b-a362e9ffc06e for instance 39775e82-0123-41cf-ad97-d3865a796828 on user Apr 23 03:52:23 user devstack@n-api.service[61306]: INFO nova.api.openstack.requestlog [req-0183b798-c888-4367-8e4f-c4c873cca202 req-63b312cc-da1b-4f2e-af2a-2e5266d16db7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047846 Apr 23 03:52:23 user devstack@n-api.service[61306]: [pid: 61306|app: 0|req: 90/274] 10.0.0.210 () {68 vars in 1394 bytes} [Sun Apr 23 03:52:23 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 23 03:52:48 user devstack@n-api.service[61308]: DEBUG dbcounter [-] [61308] Writing DB stats nova_cell0:SELECT=2 {{(pid=61308) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:52:48 user devstack@n-api.service[61308]: DEBUG dbcounter [-] [61308] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1 {{(pid=61308) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:52:48 user devstack@n-api.service[61308]: DEBUG dbcounter [-] [61308] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61308) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:52:48 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi [None req-d08a0b3e-02e4-4515-9009-64c76caec7a2 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Calling method '>' {{(pid=61308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 03:52:48 user devstack@n-api.service[61308]: DEBUG nova.compute.api [None req-d08a0b3e-02e4-4515-9009-64c76caec7a2 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] [instance: 7c1f1f24-62f5-4e51-8c74-b5b89b6585a4] Fetching instance by UUID {{(pid=61308) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 23 03:52:48 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-d08a0b3e-02e4-4515-9009-64c76caec7a2 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:52:48 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-d08a0b3e-02e4-4515-9009-64c76caec7a2 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:52:48 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-d08a0b3e-02e4-4515-9009-64c76caec7a2 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:52:48 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-d08a0b3e-02e4-4515-9009-64c76caec7a2 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:52:48 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-d08a0b3e-02e4-4515-9009-64c76caec7a2 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:52:48 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-d08a0b3e-02e4-4515-9009-64c76caec7a2 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:52:48 user devstack@n-api.service[61308]: INFO nova.api.openstack.wsgi [None req-d08a0b3e-02e4-4515-9009-64c76caec7a2 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] HTTP exception thrown: Instance 7c1f1f24-62f5-4e51-8c74-b5b89b6585a4 could not be found. Apr 23 03:52:48 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi [None req-d08a0b3e-02e4-4515-9009-64c76caec7a2 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Request method failure captured: Apr 23 03:52:48 user devstack@n-api.service[61308]: request: GET /compute/v2.1/servers/7c1f1f24-62f5-4e51-8c74-b5b89b6585a4 HTTP/1.1 Apr 23 03:52:48 user devstack@n-api.service[61308]: Accept: application/json Apr 23 03:52:48 user devstack@n-api.service[61308]: Accept-Encoding: identity Apr 23 03:52:48 user devstack@n-api.service[61308]: Connection: close Apr 23 03:52:48 user devstack@n-api.service[61308]: Content-Length: 0 Apr 23 03:52:48 user devstack@n-api.service[61308]: Content-Type: application/json Apr 23 03:52:48 user devstack@n-api.service[61308]: Host: 10.0.0.210 Apr 23 03:52:48 user devstack@n-api.service[61308]: Openstack-System-Scope: None Apr 23 03:52:48 user devstack@n-api.service[61308]: User-Agent: python-urllib3/1.26.15 Apr 23 03:52:48 user devstack@n-api.service[61308]: X-Auth-Token: gAAAAABkRKpATlQnMMf7AtMe3Mh47zSQG6r9ePVSL6VRK9keRxp6Gc7HMzsz_tP8tNowWY8eeXU0HpQXr0oDoCaKK212ZCUgOzicpa4lTfvIkKDveVvGHNmHGf_zIb8xjb2T8bafSts450cf0HsaSh4WH6WoE9_DYKPyo7TkDFQdEsMNjyWu92U Apr 23 03:52:48 user devstack@n-api.service[61308]: X-Domain-Id: None Apr 23 03:52:48 user devstack@n-api.service[61308]: X-Domain-Name: None Apr 23 03:52:48 user devstack@n-api.service[61308]: X-Identity-Status: Confirmed Apr 23 03:52:48 user devstack@n-api.service[61308]: X-Is-Admin-Project: True Apr 23 03:52:48 user devstack@n-api.service[61308]: X-Project-Domain-Id: default Apr 23 03:52:48 user devstack@n-api.service[61308]: X-Project-Domain-Name: Default Apr 23 03:52:48 user devstack@n-api.service[61308]: X-Project-Id: 24fff486a500421397ecb935828582cd Apr 23 03:52:48 user devstack@n-api.service[61308]: X-Project-Name: tempest-AttachVolumeNegativeTest-636753786 Apr 23 03:52:48 user devstack@n-api.service[61308]: X-Role: reader,member Apr 23 03:52:48 user devstack@n-api.service[61308]: X-Roles: reader,member Apr 23 03:52:48 user devstack@n-api.service[61308]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/24fff486a500421397ecb935828582cd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/24fff486a500421397ecb935828582cd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/24fff486a500421397ecb935828582cd"}]}] Apr 23 03:52:48 user devstack@n-api.service[61308]: X-Tenant: tempest-AttachVolumeNegativeTest-636753786 Apr 23 03:52:48 user devstack@n-api.service[61308]: X-Tenant-Id: 24fff486a500421397ecb935828582cd Apr 23 03:52:48 user devstack@n-api.service[61308]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-636753786 Apr 23 03:52:48 user devstack@n-api.service[61308]: X-User: tempest-AttachVolumeNegativeTest-636753786-project-member Apr 23 03:52:48 user devstack@n-api.service[61308]: X-User-Domain-Id: default Apr 23 03:52:48 user devstack@n-api.service[61308]: X-User-Domain-Name: Default Apr 23 03:52:48 user devstack@n-api.service[61308]: X-User-Id: 0a2c459cad014b07b2613e5e261d88aa Apr 23 03:52:48 user devstack@n-api.service[61308]: X-User-Name: tempest-AttachVolumeNegativeTest-636753786-project-member Apr 23 03:52:48 user devstack@n-api.service[61308]: method: > Apr 23 03:52:48 user devstack@n-api.service[61308]: exception: Instance 7c1f1f24-62f5-4e51-8c74-b5b89b6585a4 could not be found. Apr 23 03:52:48 user devstack@n-api.service[61308]: action_args: {'id': '7c1f1f24-62f5-4e51-8c74-b5b89b6585a4'} Apr 23 03:52:48 user devstack@n-api.service[61308]: {{(pid=61308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 23 03:52:48 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 23 03:52:48 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 23 03:52:48 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 23 03:52:48 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 23 03:52:48 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 23 03:52:48 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 23 03:52:48 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 23 03:52:48 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 23 03:52:48 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 23 03:52:48 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c1f1f24-62f5-4e51-8c74-b5b89b6585a4 could not be found. Apr 23 03:52:48 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi Apr 23 03:52:48 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 23 03:52:48 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi Apr 23 03:52:48 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 23 03:52:48 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 23 03:52:48 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 23 03:52:48 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 23 03:52:48 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 23 03:52:48 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 23 03:52:48 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 23 03:52:48 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 23 03:52:48 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 23 03:52:48 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 23 03:52:48 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 23 03:52:48 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 23 03:52:48 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 23 03:52:48 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c1f1f24-62f5-4e51-8c74-b5b89b6585a4 could not be found. Apr 23 03:52:48 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi Apr 23 03:52:48 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 23 03:52:48 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi Apr 23 03:52:48 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 23 03:52:48 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 23 03:52:48 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 23 03:52:48 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 23 03:52:48 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 23 03:52:48 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c1f1f24-62f5-4e51-8c74-b5b89b6585a4 could not be found. Apr 23 03:52:48 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi Apr 23 03:52:48 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi [None req-d08a0b3e-02e4-4515-9009-64c76caec7a2 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Returning 404 to user: Instance 7c1f1f24-62f5-4e51-8c74-b5b89b6585a4 could not be found. {{(pid=61308) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 23 03:52:48 user devstack@n-api.service[61308]: INFO nova.api.openstack.requestlog [None req-d08a0b3e-02e4-4515-9009-64c76caec7a2 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7c1f1f24-62f5-4e51-8c74-b5b89b6585a4" status: 404 len: 111 microversion: 2.1 time: 0.142998 Apr 23 03:52:48 user devstack@n-api.service[61308]: [pid: 61308|app: 0|req: 94/275] 10.0.0.210 () {62 vars in 1313 bytes} [Sun Apr 23 03:52:48 2023] GET /compute/v2.1/servers/7c1f1f24-62f5-4e51-8c74-b5b89b6585a4 => generated 111 bytes in 144 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 23 03:52:48 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi [None req-2da4be5a-c749-42d9-b1d6-b2328e623103 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Calling method '.version_select at 0x7f21e1253d00>' {{(pid=61307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 03:52:48 user devstack@n-api.service[61307]: DEBUG dbcounter [-] [61307] Writing DB stats nova_cell0:SELECT=2 {{(pid=61307) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:52:48 user devstack@n-api.service[61307]: DEBUG dbcounter [-] [61307] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=61307) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:52:48 user devstack@n-api.service[61307]: DEBUG dbcounter [-] [61307] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61307) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:52:48 user devstack@n-api.service[61307]: INFO nova.api.openstack.requestlog [None req-2da4be5a-c749-42d9-b1d6-b2328e623103 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-152318519" status: 202 len: 0 microversion: 2.1 time: 0.031752 Apr 23 03:52:48 user devstack@n-api.service[61307]: [pid: 61307|app: 0|req: 92/276] 10.0.0.210 () {62 vars in 1295 bytes} [Sun Apr 23 03:52:48 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-152318519 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 23 03:52:49 user devstack@n-api.service[61306]: DEBUG dbcounter [-] [61306] Writing DB stats nova_cell0:SELECT=4 {{(pid=61306) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:52:49 user devstack@n-api.service[61306]: DEBUG dbcounter [-] [61306] Writing DB stats nova_cell0:SELECT=12 {{(pid=61306) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:52:49 user devstack@n-api.service[61306]: DEBUG dbcounter [-] [61306] Writing DB stats nova_api:SELECT=52,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=61306) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:52:49 user devstack@n-api.service[61306]: DEBUG dbcounter [-] [61306] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61306) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:52:49 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi [None req-a6c95b3f-4749-4942-ac15-94e4195e110d tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Action: 'create', calling method: .version_select at 0x7f21e12e2440>, body: {"keypair": {"name": "tempest-keypair-325673571", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIs7ux48o2nnGrdeOCvQDySG+P6nXioDJdGS6oeGudA0JHf7ZhHzg403SyXAde6YT5+5r+rVL2ZP2ipzilgOZRPzvYzNtjeBNGfwBpGBza8LD5gUqZ8keZPqVn3njSi8NQ=="}} {{(pid=61306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 03:52:49 user devstack@n-api.service[61306]: DEBUG nova.quota [None req-a6c95b3f-4749-4942-ac15-94e4195e110d tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Getting quotas for project 24fff486a500421397ecb935828582cd. Resources: {'key_pairs'} {{(pid=61306) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 23 03:52:49 user devstack@n-api.service[61306]: DEBUG nova.quota [None req-a6c95b3f-4749-4942-ac15-94e4195e110d tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Getting quotas for user 0a2c459cad014b07b2613e5e261d88aa and project 24fff486a500421397ecb935828582cd. Resources: {'key_pairs'} {{(pid=61306) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 23 03:52:49 user devstack@n-api.service[61306]: INFO nova.api.openstack.requestlog [None req-a6c95b3f-4749-4942-ac15-94e4195e110d tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.062583 Apr 23 03:52:49 user devstack@n-api.service[61306]: [pid: 61306|app: 0|req: 91/277] 10.0.0.210 () {64 vars in 1236 bytes} [Sun Apr 23 03:52:49 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 23 03:52:50 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi [None req-064b620c-6fea-439a-a32e-c927ccd765de tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-159009824", "imageRef": "e6127373-9931-4277-9458-eceef653ea1e", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "6adb189c-9b46-4da4-a34b-31edf8685498"}], "security_groups": [{"name": "tempest-securitygroup--384245726"}], "key_name": "tempest-keypair-325673571", "user_data": "}} {{(pid=61308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 03:52:50 user devstack@n-api.service[61308]: DEBUG nova.network.neutron [None req-064b620c-6fea-439a-a32e-c927ccd765de tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] validate_networks() for [('6adb189c-9b46-4da4-a34b-31edf8685498', None, None, None, None, None)] {{(pid=61308) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 23 03:52:51 user devstack@n-api.service[61308]: DEBUG nova.virt.hardware [None req-064b620c-6fea-439a-a32e-c927ccd765de tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Flavor limits 0:0:0 {{(pid=61308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 23 03:52:51 user devstack@n-api.service[61308]: DEBUG nova.virt.hardware [None req-064b620c-6fea-439a-a32e-c927ccd765de tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Image limits 0:0:0 {{(pid=61308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 23 03:52:51 user devstack@n-api.service[61308]: DEBUG nova.virt.hardware [None req-064b620c-6fea-439a-a32e-c927ccd765de tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Flavor pref 0:0:0 {{(pid=61308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 23 03:52:51 user devstack@n-api.service[61308]: DEBUG nova.virt.hardware [None req-064b620c-6fea-439a-a32e-c927ccd765de tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Image pref 0:0:0 {{(pid=61308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 23 03:52:51 user devstack@n-api.service[61308]: DEBUG nova.virt.hardware [None req-064b620c-6fea-439a-a32e-c927ccd765de tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 23 03:52:51 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-064b620c-6fea-439a-a32e-c927ccd765de tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:52:51 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-064b620c-6fea-439a-a32e-c927ccd765de tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:52:51 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-064b620c-6fea-439a-a32e-c927ccd765de tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:52:51 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-064b620c-6fea-439a-a32e-c927ccd765de tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:52:51 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-064b620c-6fea-439a-a32e-c927ccd765de tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:52:51 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-064b620c-6fea-439a-a32e-c927ccd765de tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:52:51 user devstack@n-api.service[61308]: DEBUG nova.quota [None req-064b620c-6fea-439a-a32e-c927ccd765de tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Getting quotas for project 24fff486a500421397ecb935828582cd. Resources: {'ram', 'instances', 'cores'} {{(pid=61308) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 23 03:52:51 user devstack@n-api.service[61308]: DEBUG nova.quota [None req-064b620c-6fea-439a-a32e-c927ccd765de tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Getting quotas for user 0a2c459cad014b07b2613e5e261d88aa and project 24fff486a500421397ecb935828582cd. Resources: {'ram', 'instances', 'cores'} {{(pid=61308) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 23 03:52:51 user devstack@n-api.service[61308]: DEBUG nova.compute.api [None req-064b620c-6fea-439a-a32e-c927ccd765de tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Going to run 1 instances... {{(pid=61308) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 23 03:52:51 user devstack@n-api.service[61308]: DEBUG nova.compute.api [None req-064b620c-6fea-439a-a32e-c927ccd765de tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] [instance: c21ec3a3-0761-4543-ad43-dca2913d159b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e6127373-9931-4277-9458-eceef653ea1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61308) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 23 03:52:51 user devstack@n-api.service[61308]: INFO nova.api.openstack.requestlog [None req-064b620c-6fea-439a-a32e-c927ccd765de tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 0.687045 Apr 23 03:52:51 user devstack@n-api.service[61308]: [pid: 61308|app: 0|req: 95/278] 10.0.0.210 () {64 vars in 1224 bytes} [Sun Apr 23 03:52:50 2023] POST /compute/v2.1/servers => generated 399 bytes in 689 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 23 03:52:51 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi [None req-7b903db6-d1ea-44ab-840d-0f9473b24ab6 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Calling method '>' {{(pid=61307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 03:52:51 user devstack@n-api.service[61307]: DEBUG nova.compute.api [None req-7b903db6-d1ea-44ab-840d-0f9473b24ab6 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] [instance: c21ec3a3-0761-4543-ad43-dca2913d159b] Fetching instance by UUID {{(pid=61307) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 23 03:52:51 user devstack@n-api.service[61307]: DEBUG nova.policy [None req-7b903db6-d1ea-44ab-840d-0f9473b24ab6 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2c459cad014b07b2613e5e261d88aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24fff486a500421397ecb935828582cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61307) authorize /opt/stack/nova/nova/policy.py:203}} Apr 23 03:52:51 user devstack@n-api.service[61307]: INFO nova.api.openstack.requestlog [None req-7b903db6-d1ea-44ab-840d-0f9473b24ab6 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c21ec3a3-0761-4543-ad43-dca2913d159b" status: 200 len: 1234 microversion: 2.1 time: 0.107305 Apr 23 03:52:51 user devstack@n-api.service[61307]: [pid: 61307|app: 0|req: 93/279] 10.0.0.210 () {62 vars in 1313 bytes} [Sun Apr 23 03:52:51 2023] GET /compute/v2.1/servers/c21ec3a3-0761-4543-ad43-dca2913d159b => generated 1234 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 23 03:52:51 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi [None req-6676ecea-2d35-4811-a380-3ebf9ee6857c tempest-VolumesAdminNegativeTest-594073230 tempest-VolumesAdminNegativeTest-594073230-project-member] Calling method '>' {{(pid=61306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 03:52:51 user devstack@n-api.service[61306]: DEBUG nova.compute.api [None req-6676ecea-2d35-4811-a380-3ebf9ee6857c tempest-VolumesAdminNegativeTest-594073230 tempest-VolumesAdminNegativeTest-594073230-project-member] [instance: 91756f90-733e-4aa5-9108-d2d8b1d020fe] Fetching instance by UUID {{(pid=61306) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 23 03:52:51 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-6676ecea-2d35-4811-a380-3ebf9ee6857c tempest-VolumesAdminNegativeTest-594073230 tempest-VolumesAdminNegativeTest-594073230-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:52:51 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-6676ecea-2d35-4811-a380-3ebf9ee6857c tempest-VolumesAdminNegativeTest-594073230 tempest-VolumesAdminNegativeTest-594073230-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:52:51 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-6676ecea-2d35-4811-a380-3ebf9ee6857c tempest-VolumesAdminNegativeTest-594073230 tempest-VolumesAdminNegativeTest-594073230-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:52:51 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-6676ecea-2d35-4811-a380-3ebf9ee6857c tempest-VolumesAdminNegativeTest-594073230 tempest-VolumesAdminNegativeTest-594073230-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:52:51 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-6676ecea-2d35-4811-a380-3ebf9ee6857c tempest-VolumesAdminNegativeTest-594073230 tempest-VolumesAdminNegativeTest-594073230-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:52:51 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-6676ecea-2d35-4811-a380-3ebf9ee6857c tempest-VolumesAdminNegativeTest-594073230 tempest-VolumesAdminNegativeTest-594073230-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:52:51 user devstack@n-api.service[61306]: INFO nova.api.openstack.wsgi [None req-6676ecea-2d35-4811-a380-3ebf9ee6857c tempest-VolumesAdminNegativeTest-594073230 tempest-VolumesAdminNegativeTest-594073230-project-member] HTTP exception thrown: Instance 91756f90-733e-4aa5-9108-d2d8b1d020fe could not be found. Apr 23 03:52:51 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi [None req-6676ecea-2d35-4811-a380-3ebf9ee6857c tempest-VolumesAdminNegativeTest-594073230 tempest-VolumesAdminNegativeTest-594073230-project-member] Request method failure captured: Apr 23 03:52:51 user devstack@n-api.service[61306]: request: GET /compute/v2.1/servers/91756f90-733e-4aa5-9108-d2d8b1d020fe HTTP/1.1 Apr 23 03:52:51 user devstack@n-api.service[61306]: Accept: application/json Apr 23 03:52:51 user devstack@n-api.service[61306]: Accept-Encoding: identity Apr 23 03:52:51 user devstack@n-api.service[61306]: Connection: close Apr 23 03:52:51 user devstack@n-api.service[61306]: Content-Length: 0 Apr 23 03:52:51 user devstack@n-api.service[61306]: Content-Type: application/json Apr 23 03:52:51 user devstack@n-api.service[61306]: Host: 10.0.0.210 Apr 23 03:52:51 user devstack@n-api.service[61306]: Openstack-System-Scope: None Apr 23 03:52:51 user devstack@n-api.service[61306]: User-Agent: python-urllib3/1.26.15 Apr 23 03:52:51 user devstack@n-api.service[61306]: X-Auth-Token: gAAAAABkRKo7Cds5ZlyNxxlsfeb9wXDvomZDOKxYSlMZqrfQWO16gEBrdjeg1HP-0NEMAOJMrby_4c0WJHes13qxtnKqP1gK985awixigq-bI0SCZvPKg31tiBgD6bvzqOnjW7y2a1fvOE0pWu1Gettr1j-2C4NLqM5vCoUalTE-eilg4IlGLDI Apr 23 03:52:51 user devstack@n-api.service[61306]: X-Domain-Id: None Apr 23 03:52:51 user devstack@n-api.service[61306]: X-Domain-Name: None Apr 23 03:52:51 user devstack@n-api.service[61306]: X-Identity-Status: Confirmed Apr 23 03:52:51 user devstack@n-api.service[61306]: X-Is-Admin-Project: True Apr 23 03:52:51 user devstack@n-api.service[61306]: X-Project-Domain-Id: default Apr 23 03:52:51 user devstack@n-api.service[61306]: X-Project-Domain-Name: Default Apr 23 03:52:51 user devstack@n-api.service[61306]: X-Project-Id: 5eb0a03655cf4aa78e27c81ea4e1c424 Apr 23 03:52:51 user devstack@n-api.service[61306]: X-Project-Name: tempest-VolumesAdminNegativeTest-594073230 Apr 23 03:52:51 user devstack@n-api.service[61306]: X-Role: reader,member Apr 23 03:52:51 user devstack@n-api.service[61306]: X-Roles: reader,member Apr 23 03:52:51 user devstack@n-api.service[61306]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5eb0a03655cf4aa78e27c81ea4e1c424"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5eb0a03655cf4aa78e27c81ea4e1c424"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/5eb0a03655cf4aa78e27c81ea4e1c424"}]}] Apr 23 03:52:51 user devstack@n-api.service[61306]: X-Tenant: tempest-VolumesAdminNegativeTest-594073230 Apr 23 03:52:51 user devstack@n-api.service[61306]: X-Tenant-Id: 5eb0a03655cf4aa78e27c81ea4e1c424 Apr 23 03:52:51 user devstack@n-api.service[61306]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-594073230 Apr 23 03:52:51 user devstack@n-api.service[61306]: X-User: tempest-VolumesAdminNegativeTest-594073230-project-member Apr 23 03:52:51 user devstack@n-api.service[61306]: X-User-Domain-Id: default Apr 23 03:52:51 user devstack@n-api.service[61306]: X-User-Domain-Name: Default Apr 23 03:52:51 user devstack@n-api.service[61306]: X-User-Id: 3e80c354abd34bd3a28ddaeec9535af2 Apr 23 03:52:51 user devstack@n-api.service[61306]: X-User-Name: tempest-VolumesAdminNegativeTest-594073230-project-member Apr 23 03:52:51 user devstack@n-api.service[61306]: method: > Apr 23 03:52:51 user devstack@n-api.service[61306]: exception: Instance 91756f90-733e-4aa5-9108-d2d8b1d020fe could not be found. Apr 23 03:52:51 user devstack@n-api.service[61306]: action_args: {'id': '91756f90-733e-4aa5-9108-d2d8b1d020fe'} Apr 23 03:52:51 user devstack@n-api.service[61306]: {{(pid=61306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 23 03:52:51 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 23 03:52:51 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 23 03:52:51 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 23 03:52:51 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 23 03:52:51 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 23 03:52:51 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 23 03:52:51 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 23 03:52:51 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 23 03:52:51 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 23 03:52:51 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91756f90-733e-4aa5-9108-d2d8b1d020fe could not be found. Apr 23 03:52:51 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi Apr 23 03:52:51 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 23 03:52:51 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi Apr 23 03:52:51 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 23 03:52:51 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 23 03:52:51 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 23 03:52:51 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 23 03:52:51 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 23 03:52:51 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 23 03:52:51 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 23 03:52:51 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 23 03:52:51 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 23 03:52:51 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 23 03:52:51 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 23 03:52:51 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 23 03:52:51 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 23 03:52:51 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91756f90-733e-4aa5-9108-d2d8b1d020fe could not be found. Apr 23 03:52:51 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi Apr 23 03:52:51 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 23 03:52:51 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi Apr 23 03:52:51 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 23 03:52:51 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 23 03:52:51 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 23 03:52:51 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 23 03:52:51 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 23 03:52:51 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91756f90-733e-4aa5-9108-d2d8b1d020fe could not be found. Apr 23 03:52:51 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi Apr 23 03:52:51 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi [None req-6676ecea-2d35-4811-a380-3ebf9ee6857c tempest-VolumesAdminNegativeTest-594073230 tempest-VolumesAdminNegativeTest-594073230-project-member] Returning 404 to user: Instance 91756f90-733e-4aa5-9108-d2d8b1d020fe could not be found. {{(pid=61306) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 23 03:52:51 user devstack@n-api.service[61306]: INFO nova.api.openstack.requestlog [None req-6676ecea-2d35-4811-a380-3ebf9ee6857c tempest-VolumesAdminNegativeTest-594073230 tempest-VolumesAdminNegativeTest-594073230-project-member] 10.0.0.210 "GET /compute/v2.1/servers/91756f90-733e-4aa5-9108-d2d8b1d020fe" status: 404 len: 111 microversion: 2.1 time: 0.120962 Apr 23 03:52:51 user devstack@n-api.service[61306]: [pid: 61306|app: 0|req: 92/280] 10.0.0.210 () {62 vars in 1313 bytes} [Sun Apr 23 03:52:51 2023] GET /compute/v2.1/servers/91756f90-733e-4aa5-9108-d2d8b1d020fe => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 23 03:52:51 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi [None req-78262b2a-f0d1-48da-ab26-d8b03c7d7900 tempest-VolumesAdminNegativeTest-594073230 tempest-VolumesAdminNegativeTest-594073230-project-member] Calling method '.version_select at 0x7f21e1436f80>' {{(pid=61308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 03:52:51 user devstack@n-api.service[61308]: INFO nova.api.openstack.requestlog [None req-78262b2a-f0d1-48da-ab26-d8b03c7d7900 tempest-VolumesAdminNegativeTest-594073230 tempest-VolumesAdminNegativeTest-594073230-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-780145109" status: 202 len: 0 microversion: 2.1 time: 0.021540 Apr 23 03:52:51 user devstack@n-api.service[61308]: [pid: 61308|app: 0|req: 96/281] 10.0.0.210 () {62 vars in 1295 bytes} [Sun Apr 23 03:52:51 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-780145109 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 23 03:52:54 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi [req-bd458a0b-827e-434b-a0ad-925ccd341ee3 req-2fca7edd-d1f3-4840-9910-5545e3aa7d46 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c21ec3a3-0761-4543-ad43-dca2913d159b", "tag": "3cc621aa-a5f6-46de-bfd8-32dada7ca345"}]} {{(pid=61307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 03:52:54 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [req-bd458a0b-827e-434b-a0ad-925ccd341ee3 req-2fca7edd-d1f3-4840-9910-5545e3aa7d46 service nova] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:52:54 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [req-bd458a0b-827e-434b-a0ad-925ccd341ee3 req-2fca7edd-d1f3-4840-9910-5545e3aa7d46 service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:52:54 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [req-bd458a0b-827e-434b-a0ad-925ccd341ee3 req-2fca7edd-d1f3-4840-9910-5545e3aa7d46 service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:52:54 user devstack@n-api.service[61307]: INFO nova.api.openstack.compute.server_external_events [req-bd458a0b-827e-434b-a0ad-925ccd341ee3 req-2fca7edd-d1f3-4840-9910-5545e3aa7d46 service nova] Creating event network-changed:3cc621aa-a5f6-46de-bfd8-32dada7ca345 for instance c21ec3a3-0761-4543-ad43-dca2913d159b on user Apr 23 03:52:54 user devstack@n-api.service[61307]: INFO nova.api.openstack.requestlog [req-bd458a0b-827e-434b-a0ad-925ccd341ee3 req-2fca7edd-d1f3-4840-9910-5545e3aa7d46 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044535 Apr 23 03:52:54 user devstack@n-api.service[61307]: [pid: 61307|app: 0|req: 94/282] 10.0.0.210 () {68 vars in 1394 bytes} [Sun Apr 23 03:52:54 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 23 03:52:56 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi [None req-3bca81f6-cc32-42af-80b0-2edddbb2acac tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Calling method '>' {{(pid=61306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 03:52:56 user devstack@n-api.service[61306]: DEBUG nova.compute.api [None req-3bca81f6-cc32-42af-80b0-2edddbb2acac tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] [instance: 01477cd2-cdb7-41e0-96d4-3aff879b3093] Fetching instance by UUID {{(pid=61306) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 23 03:52:56 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-3bca81f6-cc32-42af-80b0-2edddbb2acac tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:52:56 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-3bca81f6-cc32-42af-80b0-2edddbb2acac tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:52:56 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-3bca81f6-cc32-42af-80b0-2edddbb2acac tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:52:56 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-3bca81f6-cc32-42af-80b0-2edddbb2acac tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:52:56 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-3bca81f6-cc32-42af-80b0-2edddbb2acac tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:52:56 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-3bca81f6-cc32-42af-80b0-2edddbb2acac tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:52:56 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi [req-f2c383ec-709e-4127-80c5-47a2f6ff7f03 req-20da1690-a8e9-413d-a7d1-ce452aad81d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c21ec3a3-0761-4543-ad43-dca2913d159b", "name": "network-vif-plugged", "status": "completed", "tag": "3cc621aa-a5f6-46de-bfd8-32dada7ca345"}]} {{(pid=61308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 03:52:56 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [req-f2c383ec-709e-4127-80c5-47a2f6ff7f03 req-20da1690-a8e9-413d-a7d1-ce452aad81d3 service nova] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:52:56 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [req-f2c383ec-709e-4127-80c5-47a2f6ff7f03 req-20da1690-a8e9-413d-a7d1-ce452aad81d3 service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:52:56 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [req-f2c383ec-709e-4127-80c5-47a2f6ff7f03 req-20da1690-a8e9-413d-a7d1-ce452aad81d3 service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:52:56 user devstack@n-api.service[61308]: INFO nova.api.openstack.compute.server_external_events [req-f2c383ec-709e-4127-80c5-47a2f6ff7f03 req-20da1690-a8e9-413d-a7d1-ce452aad81d3 service nova] Creating event network-vif-plugged:3cc621aa-a5f6-46de-bfd8-32dada7ca345 for instance c21ec3a3-0761-4543-ad43-dca2913d159b on user Apr 23 03:52:56 user devstack@n-api.service[61308]: INFO nova.api.openstack.requestlog [req-f2c383ec-709e-4127-80c5-47a2f6ff7f03 req-20da1690-a8e9-413d-a7d1-ce452aad81d3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033607 Apr 23 03:52:56 user devstack@n-api.service[61308]: [pid: 61308|app: 0|req: 97/283] 10.0.0.210 () {68 vars in 1394 bytes} [Sun Apr 23 03:52:56 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 23 03:52:56 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-3bca81f6-cc32-42af-80b0-2edddbb2acac tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:52:56 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-3bca81f6-cc32-42af-80b0-2edddbb2acac tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:52:56 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-3bca81f6-cc32-42af-80b0-2edddbb2acac tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:52:56 user devstack@n-api.service[61306]: DEBUG nova.objects.instance [None req-3bca81f6-cc32-42af-80b0-2edddbb2acac tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Lazy-loading 'fault' on Instance uuid 01477cd2-cdb7-41e0-96d4-3aff879b3093 {{(pid=61306) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 23 03:52:56 user devstack@n-api.service[61306]: DEBUG nova.policy [None req-3bca81f6-cc32-42af-80b0-2edddbb2acac tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99495726467944c38620831fc93e2856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79e09b1c4ae4cc5ab11c3e56ee4f0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61306) authorize /opt/stack/nova/nova/policy.py:203}} Apr 23 03:52:56 user devstack@n-api.service[61306]: DEBUG nova.policy [None req-3bca81f6-cc32-42af-80b0-2edddbb2acac tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99495726467944c38620831fc93e2856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79e09b1c4ae4cc5ab11c3e56ee4f0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61306) authorize /opt/stack/nova/nova/policy.py:203}} Apr 23 03:52:56 user devstack@n-api.service[61306]: DEBUG nova.policy [None req-3bca81f6-cc32-42af-80b0-2edddbb2acac tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99495726467944c38620831fc93e2856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79e09b1c4ae4cc5ab11c3e56ee4f0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61306) authorize /opt/stack/nova/nova/policy.py:203}} Apr 23 03:52:56 user devstack@n-api.service[61306]: INFO nova.api.openstack.requestlog [None req-3bca81f6-cc32-42af-80b0-2edddbb2acac tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] 10.0.0.210 "GET /compute/v2.1/servers/01477cd2-cdb7-41e0-96d4-3aff879b3093" status: 200 len: 1650 microversion: 2.87 time: 0.146619 Apr 23 03:52:56 user devstack@n-api.service[61306]: [pid: 61306|app: 0|req: 93/284] 10.0.0.210 () {64 vars in 1354 bytes} [Sun Apr 23 03:52:56 2023] GET /compute/v2.1/servers/01477cd2-cdb7-41e0-96d4-3aff879b3093 => generated 1650 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 23 03:52:56 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi [None req-b7ba6b61-a5d7-48fb-aa42-269ef611492e tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Calling method '>' {{(pid=61307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 03:52:56 user devstack@n-api.service[61307]: DEBUG nova.compute.api [None req-b7ba6b61-a5d7-48fb-aa42-269ef611492e tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] [instance: 01477cd2-cdb7-41e0-96d4-3aff879b3093] Fetching instance by UUID {{(pid=61307) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 23 03:52:56 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-b7ba6b61-a5d7-48fb-aa42-269ef611492e tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:52:56 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-b7ba6b61-a5d7-48fb-aa42-269ef611492e tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:52:56 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-b7ba6b61-a5d7-48fb-aa42-269ef611492e tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:52:56 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-b7ba6b61-a5d7-48fb-aa42-269ef611492e tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:52:56 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-b7ba6b61-a5d7-48fb-aa42-269ef611492e tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:52:56 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-b7ba6b61-a5d7-48fb-aa42-269ef611492e tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:52:56 user devstack@n-api.service[61307]: DEBUG nova.compute.api [None req-b7ba6b61-a5d7-48fb-aa42-269ef611492e tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] [instance: 01477cd2-cdb7-41e0-96d4-3aff879b3093] Going to try to terminate instance {{(pid=61307) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 23 03:52:56 user devstack@n-api.service[61307]: DEBUG nova.compute.api [None req-b7ba6b61-a5d7-48fb-aa42-269ef611492e tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] [instance: 01477cd2-cdb7-41e0-96d4-3aff879b3093] Doing local delete in cell d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb(cell1) {{(pid=61307) _delete /opt/stack/nova/nova/compute/api.py:2546}} Apr 23 03:52:56 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-b7ba6b61-a5d7-48fb-aa42-269ef611492e tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:52:56 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-b7ba6b61-a5d7-48fb-aa42-269ef611492e tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:52:56 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-b7ba6b61-a5d7-48fb-aa42-269ef611492e tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:52:56 user devstack@n-api.service[61307]: WARNING nova.compute.api [None req-b7ba6b61-a5d7-48fb-aa42-269ef611492e tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] [instance: 01477cd2-cdb7-41e0-96d4-3aff879b3093] instance's host None is down, deleting from database Apr 23 03:52:56 user devstack@n-api.service[61307]: DEBUG nova.network.neutron [None req-b7ba6b61-a5d7-48fb-aa42-269ef611492e tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] [instance: 01477cd2-cdb7-41e0-96d4-3aff879b3093] deallocate_for_instance() {{(pid=61307) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}} Apr 23 03:52:56 user devstack@n-api.service[61307]: DEBUG nova.network.neutron [None req-b7ba6b61-a5d7-48fb-aa42-269ef611492e tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] [instance: 01477cd2-cdb7-41e0-96d4-3aff879b3093] Instance cache missing network info. {{(pid=61307) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}} Apr 23 03:52:56 user devstack@n-api.service[61307]: DEBUG nova.network.neutron [None req-b7ba6b61-a5d7-48fb-aa42-269ef611492e tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] [instance: 01477cd2-cdb7-41e0-96d4-3aff879b3093] Updating instance_info_cache with network_info: [] {{(pid=61307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Apr 23 03:52:57 user devstack@n-api.service[61307]: DEBUG nova.compute.api [None req-b7ba6b61-a5d7-48fb-aa42-269ef611492e tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] [instance: 01477cd2-cdb7-41e0-96d4-3aff879b3093] Unable to find connector for volume None, not attempting terminate_connection. {{(pid=61307) _local_cleanup_bdm_volumes /opt/stack/nova/nova/compute/api.py:2612}} Apr 23 03:52:57 user devstack@n-api.service[61307]: WARNING nova.compute.api [None req-b7ba6b61-a5d7-48fb-aa42-269ef611492e tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] [instance: 01477cd2-cdb7-41e0-96d4-3aff879b3093] Ignoring volume cleanup failure due to Volume None could not be found.: nova.exception.VolumeNotFound: Volume None could not be found. Apr 23 03:52:57 user devstack@n-api.service[61307]: INFO nova.api.openstack.requestlog [None req-b7ba6b61-a5d7-48fb-aa42-269ef611492e tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/01477cd2-cdb7-41e0-96d4-3aff879b3093" status: 204 len: 0 microversion: 2.87 time: 0.656064 Apr 23 03:52:57 user devstack@n-api.service[61307]: [pid: 61307|app: 0|req: 95/285] 10.0.0.210 () {64 vars in 1357 bytes} [Sun Apr 23 03:52:56 2023] DELETE /compute/v2.1/servers/01477cd2-cdb7-41e0-96d4-3aff879b3093 => generated 0 bytes in 658 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 23 03:52:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi [None req-ea882282-b3a3-48fe-8032-0008b01c9a4f tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Calling method '>' {{(pid=61308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 03:52:57 user devstack@n-api.service[61308]: DEBUG nova.compute.api [None req-ea882282-b3a3-48fe-8032-0008b01c9a4f tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] [instance: 01477cd2-cdb7-41e0-96d4-3aff879b3093] Fetching instance by UUID {{(pid=61308) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 23 03:52:57 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-ea882282-b3a3-48fe-8032-0008b01c9a4f tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:52:57 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-ea882282-b3a3-48fe-8032-0008b01c9a4f tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:52:57 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-ea882282-b3a3-48fe-8032-0008b01c9a4f tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:52:57 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-ea882282-b3a3-48fe-8032-0008b01c9a4f tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:52:57 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-ea882282-b3a3-48fe-8032-0008b01c9a4f tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:52:57 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-ea882282-b3a3-48fe-8032-0008b01c9a4f tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:52:57 user devstack@n-api.service[61308]: INFO nova.api.openstack.wsgi [None req-ea882282-b3a3-48fe-8032-0008b01c9a4f tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] HTTP exception thrown: Instance 01477cd2-cdb7-41e0-96d4-3aff879b3093 could not be found. Apr 23 03:52:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi [None req-ea882282-b3a3-48fe-8032-0008b01c9a4f tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Request method failure captured: Apr 23 03:52:57 user devstack@n-api.service[61308]: request: GET /compute/v2.1/servers/01477cd2-cdb7-41e0-96d4-3aff879b3093 HTTP/1.1 Apr 23 03:52:57 user devstack@n-api.service[61308]: Accept: application/json Apr 23 03:52:57 user devstack@n-api.service[61308]: Accept-Encoding: identity Apr 23 03:52:57 user devstack@n-api.service[61308]: Connection: close Apr 23 03:52:57 user devstack@n-api.service[61308]: Content-Length: 0 Apr 23 03:52:57 user devstack@n-api.service[61308]: Content-Type: application/json Apr 23 03:52:57 user devstack@n-api.service[61308]: Host: 10.0.0.210 Apr 23 03:52:57 user devstack@n-api.service[61308]: Openstack-System-Scope: None Apr 23 03:52:57 user devstack@n-api.service[61308]: User-Agent: python-urllib3/1.26.15 Apr 23 03:52:57 user devstack@n-api.service[61308]: X-Auth-Token: gAAAAABkRKqymTVo46ELxd1uSw-EAoRR5lujatiDr7IMoAhu4i8DKWULtOBBybCOSHvaEwkXcd5s0zATq7gbIXqGH0um8sKXUKLCZOTVf0WZe1CrOig4R-b1xOF2MgBI4Lr-InRHxovj2jR4wzIZeUUz6B2eBSbR5fbWI_3Fzi1ZiHFHIpTIGPE Apr 23 03:52:57 user devstack@n-api.service[61308]: X-Domain-Id: None Apr 23 03:52:57 user devstack@n-api.service[61308]: X-Domain-Name: None Apr 23 03:52:57 user devstack@n-api.service[61308]: X-Identity-Status: Confirmed Apr 23 03:52:57 user devstack@n-api.service[61308]: X-Is-Admin-Project: True Apr 23 03:52:57 user devstack@n-api.service[61308]: X-Openstack-Nova-Api-Version: 2.87 Apr 23 03:52:57 user devstack@n-api.service[61308]: X-Project-Domain-Id: default Apr 23 03:52:57 user devstack@n-api.service[61308]: X-Project-Domain-Name: Default Apr 23 03:52:57 user devstack@n-api.service[61308]: X-Project-Id: a79e09b1c4ae4cc5ab11c3e56ee4f0d9 Apr 23 03:52:57 user devstack@n-api.service[61308]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-653032906 Apr 23 03:52:57 user devstack@n-api.service[61308]: X-Role: reader,member Apr 23 03:52:57 user devstack@n-api.service[61308]: X-Roles: reader,member Apr 23 03:52:57 user devstack@n-api.service[61308]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a79e09b1c4ae4cc5ab11c3e56ee4f0d9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a79e09b1c4ae4cc5ab11c3e56ee4f0d9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a79e09b1c4ae4cc5ab11c3e56ee4f0d9"}]}] Apr 23 03:52:57 user devstack@n-api.service[61308]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-653032906 Apr 23 03:52:57 user devstack@n-api.service[61308]: X-Tenant-Id: a79e09b1c4ae4cc5ab11c3e56ee4f0d9 Apr 23 03:52:57 user devstack@n-api.service[61308]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-653032906 Apr 23 03:52:57 user devstack@n-api.service[61308]: X-User: tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member Apr 23 03:52:57 user devstack@n-api.service[61308]: X-User-Domain-Id: default Apr 23 03:52:57 user devstack@n-api.service[61308]: X-User-Domain-Name: Default Apr 23 03:52:57 user devstack@n-api.service[61308]: X-User-Id: 99495726467944c38620831fc93e2856 Apr 23 03:52:57 user devstack@n-api.service[61308]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member Apr 23 03:52:57 user devstack@n-api.service[61308]: method: > Apr 23 03:52:57 user devstack@n-api.service[61308]: exception: Instance 01477cd2-cdb7-41e0-96d4-3aff879b3093 could not be found. Apr 23 03:52:57 user devstack@n-api.service[61308]: action_args: {'id': '01477cd2-cdb7-41e0-96d4-3aff879b3093'} Apr 23 03:52:57 user devstack@n-api.service[61308]: {{(pid=61308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 23 03:52:57 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 23 03:52:57 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 23 03:52:57 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 23 03:52:57 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 23 03:52:57 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 23 03:52:57 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 23 03:52:57 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 23 03:52:57 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 23 03:52:57 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 23 03:52:57 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01477cd2-cdb7-41e0-96d4-3aff879b3093 could not be found. Apr 23 03:52:57 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi Apr 23 03:52:57 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 23 03:52:57 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi Apr 23 03:52:57 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 23 03:52:57 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 23 03:52:57 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 23 03:52:57 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 23 03:52:57 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 23 03:52:57 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 23 03:52:57 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 23 03:52:57 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 23 03:52:57 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 23 03:52:57 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 23 03:52:57 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 23 03:52:57 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 23 03:52:57 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 23 03:52:57 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01477cd2-cdb7-41e0-96d4-3aff879b3093 could not be found. Apr 23 03:52:57 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi Apr 23 03:52:57 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 23 03:52:57 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi Apr 23 03:52:57 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 23 03:52:57 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 23 03:52:57 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 23 03:52:57 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 23 03:52:57 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 23 03:52:57 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01477cd2-cdb7-41e0-96d4-3aff879b3093 could not be found. Apr 23 03:52:57 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi Apr 23 03:52:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi [None req-ea882282-b3a3-48fe-8032-0008b01c9a4f tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Returning 404 to user: Instance 01477cd2-cdb7-41e0-96d4-3aff879b3093 could not be found. {{(pid=61308) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 23 03:52:57 user devstack@n-api.service[61308]: INFO nova.api.openstack.requestlog [None req-ea882282-b3a3-48fe-8032-0008b01c9a4f tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] 10.0.0.210 "GET /compute/v2.1/servers/01477cd2-cdb7-41e0-96d4-3aff879b3093" status: 404 len: 111 microversion: 2.87 time: 0.079005 Apr 23 03:52:57 user devstack@n-api.service[61308]: [pid: 61308|app: 0|req: 98/286] 10.0.0.210 () {64 vars in 1354 bytes} [Sun Apr 23 03:52:57 2023] GET /compute/v2.1/servers/01477cd2-cdb7-41e0-96d4-3aff879b3093 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Apr 23 03:52:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi [None req-ae9ce82a-0fab-4494-a89b-9156bb332704 tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-1016623574", "imageRef": "e6127373-9931-4277-9458-eceef653ea1e", "flavorRef": "42", "networks": [{"uuid": "25de9e6c-4c02-4658-b076-466681d96605"}]}} {{(pid=61306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 03:52:57 user devstack@n-api.service[61306]: DEBUG nova.network.neutron [None req-ae9ce82a-0fab-4494-a89b-9156bb332704 tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] validate_networks() for [('25de9e6c-4c02-4658-b076-466681d96605', None, None, None, None, None)] {{(pid=61306) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 23 03:52:58 user devstack@n-api.service[61306]: DEBUG nova.virt.hardware [None req-ae9ce82a-0fab-4494-a89b-9156bb332704 tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Flavor limits 0:0:0 {{(pid=61306) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 23 03:52:58 user devstack@n-api.service[61306]: DEBUG nova.virt.hardware [None req-ae9ce82a-0fab-4494-a89b-9156bb332704 tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Image limits 0:0:0 {{(pid=61306) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 23 03:52:58 user devstack@n-api.service[61306]: DEBUG nova.virt.hardware [None req-ae9ce82a-0fab-4494-a89b-9156bb332704 tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Flavor pref 0:0:0 {{(pid=61306) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 23 03:52:58 user devstack@n-api.service[61306]: DEBUG nova.virt.hardware [None req-ae9ce82a-0fab-4494-a89b-9156bb332704 tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Image pref 0:0:0 {{(pid=61306) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 23 03:52:58 user devstack@n-api.service[61306]: DEBUG nova.virt.hardware [None req-ae9ce82a-0fab-4494-a89b-9156bb332704 tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61306) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 23 03:52:58 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-ae9ce82a-0fab-4494-a89b-9156bb332704 tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:52:58 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-ae9ce82a-0fab-4494-a89b-9156bb332704 tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:52:58 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-ae9ce82a-0fab-4494-a89b-9156bb332704 tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:52:58 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-ae9ce82a-0fab-4494-a89b-9156bb332704 tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:52:58 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-ae9ce82a-0fab-4494-a89b-9156bb332704 tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:52:58 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-ae9ce82a-0fab-4494-a89b-9156bb332704 tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:52:58 user devstack@n-api.service[61306]: DEBUG nova.quota [None req-ae9ce82a-0fab-4494-a89b-9156bb332704 tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Getting quotas for project a79e09b1c4ae4cc5ab11c3e56ee4f0d9. Resources: {'ram', 'instances', 'cores'} {{(pid=61306) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 23 03:52:58 user devstack@n-api.service[61306]: DEBUG nova.quota [None req-ae9ce82a-0fab-4494-a89b-9156bb332704 tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Getting quotas for user 99495726467944c38620831fc93e2856 and project a79e09b1c4ae4cc5ab11c3e56ee4f0d9. Resources: {'ram', 'instances', 'cores'} {{(pid=61306) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 23 03:52:58 user devstack@n-api.service[61306]: DEBUG nova.compute.api [None req-ae9ce82a-0fab-4494-a89b-9156bb332704 tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Going to run 1 instances... {{(pid=61306) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 23 03:52:58 user devstack@n-api.service[61306]: DEBUG nova.compute.api [None req-ae9ce82a-0fab-4494-a89b-9156bb332704 tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] [instance: 97b28eb9-634c-4f9b-97ef-41d9f45f19b7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e6127373-9931-4277-9458-eceef653ea1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61306) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 23 03:52:58 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi [req-bd3bb624-238d-4b76-9b2e-f987cef352d2 req-c997de20-3c8f-4996-9d8b-3b2cac5e391a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c21ec3a3-0761-4543-ad43-dca2913d159b", "name": "network-vif-plugged", "status": "completed", "tag": "3cc621aa-a5f6-46de-bfd8-32dada7ca345"}]} {{(pid=61307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 03:52:58 user devstack@n-api.service[61306]: INFO nova.api.openstack.requestlog [None req-ae9ce82a-0fab-4494-a89b-9156bb332704 tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 1.040417 Apr 23 03:52:58 user devstack@n-api.service[61306]: [pid: 61306|app: 0|req: 94/287] 10.0.0.210 () {66 vars in 1265 bytes} [Sun Apr 23 03:52:57 2023] POST /compute/v2.1/servers => generated 378 bytes in 1044 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 23 03:52:58 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [req-bd3bb624-238d-4b76-9b2e-f987cef352d2 req-c997de20-3c8f-4996-9d8b-3b2cac5e391a service nova] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:52:58 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [req-bd3bb624-238d-4b76-9b2e-f987cef352d2 req-c997de20-3c8f-4996-9d8b-3b2cac5e391a service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:52:58 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [req-bd3bb624-238d-4b76-9b2e-f987cef352d2 req-c997de20-3c8f-4996-9d8b-3b2cac5e391a service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:52:58 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi [None req-bc8e8b7f-860f-4a3e-8503-8e5be5c191a8 tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Calling method '>' {{(pid=61308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 03:52:58 user devstack@n-api.service[61307]: INFO nova.api.openstack.compute.server_external_events [req-bd3bb624-238d-4b76-9b2e-f987cef352d2 req-c997de20-3c8f-4996-9d8b-3b2cac5e391a service nova] Creating event network-vif-plugged:3cc621aa-a5f6-46de-bfd8-32dada7ca345 for instance c21ec3a3-0761-4543-ad43-dca2913d159b on user Apr 23 03:52:58 user devstack@n-api.service[61308]: DEBUG nova.compute.api [None req-bc8e8b7f-860f-4a3e-8503-8e5be5c191a8 tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] [instance: 97b28eb9-634c-4f9b-97ef-41d9f45f19b7] Fetching instance by UUID {{(pid=61308) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 23 03:52:58 user devstack@n-api.service[61307]: INFO nova.api.openstack.requestlog [req-bd3bb624-238d-4b76-9b2e-f987cef352d2 req-c997de20-3c8f-4996-9d8b-3b2cac5e391a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042238 Apr 23 03:52:58 user devstack@n-api.service[61307]: [pid: 61307|app: 0|req: 96/288] 10.0.0.210 () {68 vars in 1394 bytes} [Sun Apr 23 03:52:58 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 23 03:52:58 user devstack@n-api.service[61308]: DEBUG nova.policy [None req-bc8e8b7f-860f-4a3e-8503-8e5be5c191a8 tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99495726467944c38620831fc93e2856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79e09b1c4ae4cc5ab11c3e56ee4f0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61308) authorize /opt/stack/nova/nova/policy.py:203}} Apr 23 03:52:58 user devstack@n-api.service[61308]: DEBUG nova.policy [None req-bc8e8b7f-860f-4a3e-8503-8e5be5c191a8 tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99495726467944c38620831fc93e2856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79e09b1c4ae4cc5ab11c3e56ee4f0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61308) authorize /opt/stack/nova/nova/policy.py:203}} Apr 23 03:52:58 user devstack@n-api.service[61308]: DEBUG nova.policy [None req-bc8e8b7f-860f-4a3e-8503-8e5be5c191a8 tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99495726467944c38620831fc93e2856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79e09b1c4ae4cc5ab11c3e56ee4f0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61308) authorize /opt/stack/nova/nova/policy.py:203}} Apr 23 03:52:58 user devstack@n-api.service[61308]: INFO nova.api.openstack.requestlog [None req-bc8e8b7f-860f-4a3e-8503-8e5be5c191a8 tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] 10.0.0.210 "GET /compute/v2.1/servers/97b28eb9-634c-4f9b-97ef-41d9f45f19b7" status: 200 len: 1395 microversion: 2.87 time: 0.147537 Apr 23 03:52:58 user devstack@n-api.service[61308]: [pid: 61308|app: 0|req: 99/289] 10.0.0.210 () {64 vars in 1354 bytes} [Sun Apr 23 03:52:58 2023] GET /compute/v2.1/servers/97b28eb9-634c-4f9b-97ef-41d9f45f19b7 => generated 1395 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 23 03:53:01 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi [req-a6c8e6e5-0601-45e8-a081-1719293612f0 req-14b1316a-96ee-4fb8-81f7-ca54f71a4f70 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97b28eb9-634c-4f9b-97ef-41d9f45f19b7", "tag": "6d65b2b7-2a9a-4e2b-b003-af767e8a544f"}]} {{(pid=61306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 03:53:01 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [req-a6c8e6e5-0601-45e8-a081-1719293612f0 req-14b1316a-96ee-4fb8-81f7-ca54f71a4f70 service nova] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:53:01 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [req-a6c8e6e5-0601-45e8-a081-1719293612f0 req-14b1316a-96ee-4fb8-81f7-ca54f71a4f70 service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:53:01 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [req-a6c8e6e5-0601-45e8-a081-1719293612f0 req-14b1316a-96ee-4fb8-81f7-ca54f71a4f70 service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:53:01 user devstack@n-api.service[61306]: INFO nova.api.openstack.compute.server_external_events [req-a6c8e6e5-0601-45e8-a081-1719293612f0 req-14b1316a-96ee-4fb8-81f7-ca54f71a4f70 service nova] Creating event network-changed:6d65b2b7-2a9a-4e2b-b003-af767e8a544f for instance 97b28eb9-634c-4f9b-97ef-41d9f45f19b7 on user Apr 23 03:53:01 user devstack@n-api.service[61306]: INFO nova.api.openstack.requestlog [req-a6c8e6e5-0601-45e8-a081-1719293612f0 req-14b1316a-96ee-4fb8-81f7-ca54f71a4f70 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039565 Apr 23 03:53:01 user devstack@n-api.service[61306]: [pid: 61306|app: 0|req: 95/290] 10.0.0.210 () {68 vars in 1394 bytes} [Sun Apr 23 03:53:01 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 23 03:53:03 user devstack@n-api.service[61307]: DEBUG dbcounter [-] [61307] Writing DB stats nova_cell0:SELECT=2 {{(pid=61307) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:53:03 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi [req-34dae454-273e-4295-9348-2e966d4d130b req-a15e374a-ce9d-4433-918f-80d3a237a14a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97b28eb9-634c-4f9b-97ef-41d9f45f19b7", "name": "network-vif-plugged", "status": "completed", "tag": "6d65b2b7-2a9a-4e2b-b003-af767e8a544f"}]} {{(pid=61307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 03:53:03 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [req-34dae454-273e-4295-9348-2e966d4d130b req-a15e374a-ce9d-4433-918f-80d3a237a14a service nova] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:53:03 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [req-34dae454-273e-4295-9348-2e966d4d130b req-a15e374a-ce9d-4433-918f-80d3a237a14a service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:53:03 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [req-34dae454-273e-4295-9348-2e966d4d130b req-a15e374a-ce9d-4433-918f-80d3a237a14a service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:53:03 user devstack@n-api.service[61307]: INFO nova.api.openstack.compute.server_external_events [req-34dae454-273e-4295-9348-2e966d4d130b req-a15e374a-ce9d-4433-918f-80d3a237a14a service nova] Creating event network-vif-plugged:6d65b2b7-2a9a-4e2b-b003-af767e8a544f for instance 97b28eb9-634c-4f9b-97ef-41d9f45f19b7 on user Apr 23 03:53:03 user devstack@n-api.service[61307]: INFO nova.api.openstack.requestlog [req-34dae454-273e-4295-9348-2e966d4d130b req-a15e374a-ce9d-4433-918f-80d3a237a14a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040013 Apr 23 03:53:03 user devstack@n-api.service[61307]: [pid: 61307|app: 0|req: 97/291] 10.0.0.210 () {68 vars in 1394 bytes} [Sun Apr 23 03:53:03 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 23 03:53:04 user devstack@n-api.service[61308]: DEBUG dbcounter [-] [61308] Writing DB stats nova_cell0:SELECT=2 {{(pid=61308) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:53:04 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi [None req-3f1ac945-9d33-4059-8d9e-037221e341ea tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] Calling method '>' {{(pid=61308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 03:53:04 user devstack@n-api.service[61308]: DEBUG nova.compute.api [None req-3f1ac945-9d33-4059-8d9e-037221e341ea tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] [instance: 90cce4ec-f48c-408f-8d8f-46414bde01df] Fetching instance by UUID {{(pid=61308) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 23 03:53:04 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-3f1ac945-9d33-4059-8d9e-037221e341ea tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:53:04 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-3f1ac945-9d33-4059-8d9e-037221e341ea tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:53:04 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-3f1ac945-9d33-4059-8d9e-037221e341ea tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:53:04 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-3f1ac945-9d33-4059-8d9e-037221e341ea tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:53:04 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-3f1ac945-9d33-4059-8d9e-037221e341ea tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:53:04 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-3f1ac945-9d33-4059-8d9e-037221e341ea tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:53:04 user devstack@n-api.service[61308]: INFO nova.api.openstack.wsgi [None req-3f1ac945-9d33-4059-8d9e-037221e341ea tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] HTTP exception thrown: Instance 90cce4ec-f48c-408f-8d8f-46414bde01df could not be found. Apr 23 03:53:04 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi [None req-3f1ac945-9d33-4059-8d9e-037221e341ea tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] Request method failure captured: Apr 23 03:53:04 user devstack@n-api.service[61308]: request: GET /compute/v2.1/servers/90cce4ec-f48c-408f-8d8f-46414bde01df HTTP/1.1 Apr 23 03:53:04 user devstack@n-api.service[61308]: Accept: application/json Apr 23 03:53:04 user devstack@n-api.service[61308]: Accept-Encoding: identity Apr 23 03:53:04 user devstack@n-api.service[61308]: Connection: close Apr 23 03:53:04 user devstack@n-api.service[61308]: Content-Length: 0 Apr 23 03:53:04 user devstack@n-api.service[61308]: Content-Type: application/json Apr 23 03:53:04 user devstack@n-api.service[61308]: Host: 10.0.0.210 Apr 23 03:53:04 user devstack@n-api.service[61308]: Openstack-System-Scope: None Apr 23 03:53:04 user devstack@n-api.service[61308]: User-Agent: python-urllib3/1.26.15 Apr 23 03:53:04 user devstack@n-api.service[61308]: X-Auth-Token: gAAAAABkRKpGsSgI3HJi_sm18U3cFUEuMdY0mnlrejsesmxtMa3yzukhJxxq_mWc4HtWGUcT7rcKBGD7PsBggR-8GP-uKD0bw-KmeHzKFuMPkka7MrICpRWdiO23-KB086cyB15LnVocRcuD82lRQme1YZIzB3Rf8FtwCsyiDCqB_H22XQNrKNc Apr 23 03:53:04 user devstack@n-api.service[61308]: X-Domain-Id: None Apr 23 03:53:04 user devstack@n-api.service[61308]: X-Domain-Name: None Apr 23 03:53:04 user devstack@n-api.service[61308]: X-Identity-Status: Confirmed Apr 23 03:53:04 user devstack@n-api.service[61308]: X-Is-Admin-Project: True Apr 23 03:53:04 user devstack@n-api.service[61308]: X-Project-Domain-Id: default Apr 23 03:53:04 user devstack@n-api.service[61308]: X-Project-Domain-Name: Default Apr 23 03:53:04 user devstack@n-api.service[61308]: X-Project-Id: 8ab0f01751954d04a83b360b2f839716 Apr 23 03:53:04 user devstack@n-api.service[61308]: X-Project-Name: tempest-TestMinimumBasicScenario-1558592168 Apr 23 03:53:04 user devstack@n-api.service[61308]: X-Role: reader,member Apr 23 03:53:04 user devstack@n-api.service[61308]: X-Roles: reader,member Apr 23 03:53:04 user devstack@n-api.service[61308]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8ab0f01751954d04a83b360b2f839716"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8ab0f01751954d04a83b360b2f839716"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/8ab0f01751954d04a83b360b2f839716"}]}] Apr 23 03:53:04 user devstack@n-api.service[61308]: X-Tenant: tempest-TestMinimumBasicScenario-1558592168 Apr 23 03:53:04 user devstack@n-api.service[61308]: X-Tenant-Id: 8ab0f01751954d04a83b360b2f839716 Apr 23 03:53:04 user devstack@n-api.service[61308]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1558592168 Apr 23 03:53:04 user devstack@n-api.service[61308]: X-User: tempest-TestMinimumBasicScenario-1558592168-project-member Apr 23 03:53:04 user devstack@n-api.service[61308]: X-User-Domain-Id: default Apr 23 03:53:04 user devstack@n-api.service[61308]: X-User-Domain-Name: Default Apr 23 03:53:04 user devstack@n-api.service[61308]: X-User-Id: 93a8dbfd8cef4578aff742813ffe901e Apr 23 03:53:04 user devstack@n-api.service[61308]: X-User-Name: tempest-TestMinimumBasicScenario-1558592168-project-member Apr 23 03:53:04 user devstack@n-api.service[61308]: method: > Apr 23 03:53:04 user devstack@n-api.service[61308]: exception: Instance 90cce4ec-f48c-408f-8d8f-46414bde01df could not be found. Apr 23 03:53:04 user devstack@n-api.service[61308]: action_args: {'id': '90cce4ec-f48c-408f-8d8f-46414bde01df'} Apr 23 03:53:04 user devstack@n-api.service[61308]: {{(pid=61308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 23 03:53:04 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 23 03:53:04 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 23 03:53:04 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 23 03:53:04 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 23 03:53:04 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 23 03:53:04 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 23 03:53:04 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 23 03:53:04 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 23 03:53:04 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 23 03:53:04 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90cce4ec-f48c-408f-8d8f-46414bde01df could not be found. Apr 23 03:53:04 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi Apr 23 03:53:04 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 23 03:53:04 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi Apr 23 03:53:04 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 23 03:53:04 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 23 03:53:04 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 23 03:53:04 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 23 03:53:04 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 23 03:53:04 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 23 03:53:04 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 23 03:53:04 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 23 03:53:04 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 23 03:53:04 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 23 03:53:04 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 23 03:53:04 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 23 03:53:04 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 23 03:53:04 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90cce4ec-f48c-408f-8d8f-46414bde01df could not be found. Apr 23 03:53:04 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi Apr 23 03:53:04 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 23 03:53:04 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi Apr 23 03:53:04 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 23 03:53:04 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 23 03:53:04 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 23 03:53:04 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 23 03:53:04 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 23 03:53:04 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90cce4ec-f48c-408f-8d8f-46414bde01df could not be found. Apr 23 03:53:04 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi Apr 23 03:53:04 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi [None req-3f1ac945-9d33-4059-8d9e-037221e341ea tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] Returning 404 to user: Instance 90cce4ec-f48c-408f-8d8f-46414bde01df could not be found. {{(pid=61308) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 23 03:53:04 user devstack@n-api.service[61308]: INFO nova.api.openstack.requestlog [None req-3f1ac945-9d33-4059-8d9e-037221e341ea tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] 10.0.0.210 "GET /compute/v2.1/servers/90cce4ec-f48c-408f-8d8f-46414bde01df" status: 404 len: 111 microversion: 2.1 time: 0.246766 Apr 23 03:53:04 user devstack@n-api.service[61308]: [pid: 61308|app: 0|req: 100/292] 10.0.0.210 () {62 vars in 1313 bytes} [Sun Apr 23 03:53:04 2023] GET /compute/v2.1/servers/90cce4ec-f48c-408f-8d8f-46414bde01df => generated 111 bytes in 248 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 23 03:53:04 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi [None req-539c8780-a563-4642-8ed7-44096b3337f8 tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] Calling method '.version_select at 0x7f21e12e0f70>' {{(pid=61306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 03:53:05 user devstack@n-api.service[61306]: INFO nova.api.openstack.requestlog [None req-539c8780-a563-4642-8ed7-44096b3337f8 tempest-TestMinimumBasicScenario-1558592168 tempest-TestMinimumBasicScenario-1558592168-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-962162734" status: 202 len: 0 microversion: 2.1 time: 0.033680 Apr 23 03:53:05 user devstack@n-api.service[61306]: [pid: 61306|app: 0|req: 96/293] 10.0.0.210 () {62 vars in 1346 bytes} [Sun Apr 23 03:53:04 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-962162734 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 23 03:53:05 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi [req-17390351-652e-4d19-958f-d731b3836ac7 req-d3baacb9-9d23-4cf3-9033-6ca5ea7834df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97b28eb9-634c-4f9b-97ef-41d9f45f19b7", "name": "network-vif-plugged", "status": "completed", "tag": "6d65b2b7-2a9a-4e2b-b003-af767e8a544f"}]} {{(pid=61307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 03:53:05 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [req-17390351-652e-4d19-958f-d731b3836ac7 req-d3baacb9-9d23-4cf3-9033-6ca5ea7834df service nova] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:53:05 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [req-17390351-652e-4d19-958f-d731b3836ac7 req-d3baacb9-9d23-4cf3-9033-6ca5ea7834df service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:53:05 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [req-17390351-652e-4d19-958f-d731b3836ac7 req-d3baacb9-9d23-4cf3-9033-6ca5ea7834df service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:53:05 user devstack@n-api.service[61307]: INFO nova.api.openstack.compute.server_external_events [req-17390351-652e-4d19-958f-d731b3836ac7 req-d3baacb9-9d23-4cf3-9033-6ca5ea7834df service nova] Creating event network-vif-plugged:6d65b2b7-2a9a-4e2b-b003-af767e8a544f for instance 97b28eb9-634c-4f9b-97ef-41d9f45f19b7 on user Apr 23 03:53:05 user devstack@n-api.service[61307]: INFO nova.api.openstack.requestlog [req-17390351-652e-4d19-958f-d731b3836ac7 req-d3baacb9-9d23-4cf3-9033-6ca5ea7834df service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028634 Apr 23 03:53:05 user devstack@n-api.service[61307]: [pid: 61307|app: 0|req: 98/294] 10.0.0.210 () {68 vars in 1394 bytes} [Sun Apr 23 03:53:05 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 23 03:53:06 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi [None req-520907f8-5dc2-496c-a379-8c2904a0d7ab tempest-VolumesActionsTest-911298328 tempest-VolumesActionsTest-911298328-project-member] Calling method '>' {{(pid=61308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 03:53:06 user devstack@n-api.service[61308]: DEBUG nova.compute.api [None req-520907f8-5dc2-496c-a379-8c2904a0d7ab tempest-VolumesActionsTest-911298328 tempest-VolumesActionsTest-911298328-project-member] [instance: 39775e82-0123-41cf-ad97-d3865a796828] Fetching instance by UUID {{(pid=61308) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 23 03:53:06 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-520907f8-5dc2-496c-a379-8c2904a0d7ab tempest-VolumesActionsTest-911298328 tempest-VolumesActionsTest-911298328-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:53:06 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-520907f8-5dc2-496c-a379-8c2904a0d7ab tempest-VolumesActionsTest-911298328 tempest-VolumesActionsTest-911298328-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:53:06 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-520907f8-5dc2-496c-a379-8c2904a0d7ab tempest-VolumesActionsTest-911298328 tempest-VolumesActionsTest-911298328-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:53:06 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-520907f8-5dc2-496c-a379-8c2904a0d7ab tempest-VolumesActionsTest-911298328 tempest-VolumesActionsTest-911298328-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:53:06 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-520907f8-5dc2-496c-a379-8c2904a0d7ab tempest-VolumesActionsTest-911298328 tempest-VolumesActionsTest-911298328-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:53:06 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-520907f8-5dc2-496c-a379-8c2904a0d7ab tempest-VolumesActionsTest-911298328 tempest-VolumesActionsTest-911298328-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:53:06 user devstack@n-api.service[61308]: DEBUG nova.policy [None req-520907f8-5dc2-496c-a379-8c2904a0d7ab tempest-VolumesActionsTest-911298328 tempest-VolumesActionsTest-911298328-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405152a49bf14ad68f5c96f767c70b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '037d3963711a4727a4def98cfff4da67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61308) authorize /opt/stack/nova/nova/policy.py:203}} Apr 23 03:53:06 user devstack@n-api.service[61308]: INFO nova.api.openstack.requestlog [None req-520907f8-5dc2-496c-a379-8c2904a0d7ab tempest-VolumesActionsTest-911298328 tempest-VolumesActionsTest-911298328-project-member] 10.0.0.210 "GET /compute/v2.1/servers/39775e82-0123-41cf-ad97-d3865a796828" status: 200 len: 1485 microversion: 2.1 time: 0.283188 Apr 23 03:53:06 user devstack@n-api.service[61308]: [pid: 61308|app: 0|req: 101/295] 10.0.0.210 () {62 vars in 1313 bytes} [Sun Apr 23 03:53:06 2023] GET /compute/v2.1/servers/39775e82-0123-41cf-ad97-d3865a796828 => generated 1485 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 23 03:53:14 user devstack@n-api.service[61306]: DEBUG dbcounter [-] [61306] Writing DB stats nova_cell0:SELECT=2 {{(pid=61306) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:53:14 user devstack@n-api.service[61306]: DEBUG dbcounter [-] [61306] Writing DB stats nova_cell0:SELECT=10 {{(pid=61306) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:53:14 user devstack@n-api.service[61306]: DEBUG dbcounter [-] [61306] Writing DB stats nova_cell1:SELECT=14 {{(pid=61306) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:53:14 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi [None req-ab1b79bf-406e-4382-94f5-99671f88dfa8 tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] Calling method '>' {{(pid=61306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 03:53:14 user devstack@n-api.service[61306]: DEBUG nova.compute.api [None req-ab1b79bf-406e-4382-94f5-99671f88dfa8 tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] [instance: 954f41b2-5c67-41a4-b38b-ebf3ad60cac7] Fetching instance by UUID {{(pid=61306) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 23 03:53:14 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-ab1b79bf-406e-4382-94f5-99671f88dfa8 tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:53:14 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-ab1b79bf-406e-4382-94f5-99671f88dfa8 tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:53:14 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-ab1b79bf-406e-4382-94f5-99671f88dfa8 tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:53:14 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-ab1b79bf-406e-4382-94f5-99671f88dfa8 tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:53:14 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-ab1b79bf-406e-4382-94f5-99671f88dfa8 tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:53:14 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-ab1b79bf-406e-4382-94f5-99671f88dfa8 tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:53:14 user devstack@n-api.service[61306]: DEBUG nova.policy [None req-ab1b79bf-406e-4382-94f5-99671f88dfa8 tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdc8fe94058c46c28d4b3f16dc1e77ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f44fe9ba07e4e2f925d1a8952356e04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61306) authorize /opt/stack/nova/nova/policy.py:203}} Apr 23 03:53:14 user devstack@n-api.service[61306]: INFO nova.api.openstack.requestlog [None req-ab1b79bf-406e-4382-94f5-99671f88dfa8 tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] 10.0.0.210 "GET /compute/v2.1/servers/954f41b2-5c67-41a4-b38b-ebf3ad60cac7" status: 200 len: 1658 microversion: 2.1 time: 0.272610 Apr 23 03:53:14 user devstack@n-api.service[61306]: [pid: 61306|app: 0|req: 97/296] 10.0.0.210 () {62 vars in 1313 bytes} [Sun Apr 23 03:53:14 2023] GET /compute/v2.1/servers/954f41b2-5c67-41a4-b38b-ebf3ad60cac7 => generated 1658 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 23 03:53:14 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi [None req-5355b0b0-7de6-4173-af5a-98eecbf91e6f tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] Calling method '>' {{(pid=61307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 03:53:14 user devstack@n-api.service[61307]: DEBUG nova.compute.api [None req-5355b0b0-7de6-4173-af5a-98eecbf91e6f tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] [instance: 954f41b2-5c67-41a4-b38b-ebf3ad60cac7] Fetching instance by UUID {{(pid=61307) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 23 03:53:14 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-5355b0b0-7de6-4173-af5a-98eecbf91e6f tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:53:14 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-5355b0b0-7de6-4173-af5a-98eecbf91e6f tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:53:14 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-5355b0b0-7de6-4173-af5a-98eecbf91e6f tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:53:14 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-5355b0b0-7de6-4173-af5a-98eecbf91e6f tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:53:14 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-5355b0b0-7de6-4173-af5a-98eecbf91e6f tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:53:14 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-5355b0b0-7de6-4173-af5a-98eecbf91e6f tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:53:15 user devstack@n-api.service[61307]: DEBUG nova.policy [None req-5355b0b0-7de6-4173-af5a-98eecbf91e6f tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdc8fe94058c46c28d4b3f16dc1e77ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f44fe9ba07e4e2f925d1a8952356e04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61307) authorize /opt/stack/nova/nova/policy.py:203}} Apr 23 03:53:15 user devstack@n-api.service[61307]: INFO nova.api.openstack.requestlog [None req-5355b0b0-7de6-4173-af5a-98eecbf91e6f tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] 10.0.0.210 "GET /compute/v2.1/servers/954f41b2-5c67-41a4-b38b-ebf3ad60cac7" status: 200 len: 1658 microversion: 2.1 time: 0.245787 Apr 23 03:53:15 user devstack@n-api.service[61307]: [pid: 61307|app: 0|req: 99/297] 10.0.0.210 () {62 vars in 1313 bytes} [Sun Apr 23 03:53:14 2023] GET /compute/v2.1/servers/954f41b2-5c67-41a4-b38b-ebf3ad60cac7 => generated 1658 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 23 03:53:15 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi [None req-9e1aae60-12d0-41cd-b377-99c8c1c17f25 tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] Calling method '>' {{(pid=61308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 03:53:15 user devstack@n-api.service[61308]: DEBUG nova.compute.api [None req-9e1aae60-12d0-41cd-b377-99c8c1c17f25 tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] [instance: 954f41b2-5c67-41a4-b38b-ebf3ad60cac7] Fetching instance by UUID {{(pid=61308) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 23 03:53:15 user devstack@n-api.service[61308]: DEBUG dbcounter [-] [61308] Writing DB stats nova_cell0:SELECT=8 {{(pid=61308) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:53:15 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-9e1aae60-12d0-41cd-b377-99c8c1c17f25 tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:53:15 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-9e1aae60-12d0-41cd-b377-99c8c1c17f25 tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:53:15 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-9e1aae60-12d0-41cd-b377-99c8c1c17f25 tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:53:15 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-9e1aae60-12d0-41cd-b377-99c8c1c17f25 tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:53:15 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-9e1aae60-12d0-41cd-b377-99c8c1c17f25 tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:53:15 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-9e1aae60-12d0-41cd-b377-99c8c1c17f25 tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:53:15 user devstack@n-api.service[61308]: DEBUG nova.policy [None req-9e1aae60-12d0-41cd-b377-99c8c1c17f25 tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdc8fe94058c46c28d4b3f16dc1e77ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f44fe9ba07e4e2f925d1a8952356e04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61308) authorize /opt/stack/nova/nova/policy.py:203}} Apr 23 03:53:15 user devstack@n-api.service[61308]: INFO nova.api.openstack.requestlog [None req-9e1aae60-12d0-41cd-b377-99c8c1c17f25 tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] 10.0.0.210 "GET /compute/v2.1/servers/954f41b2-5c67-41a4-b38b-ebf3ad60cac7" status: 200 len: 1658 microversion: 2.1 time: 0.146600 Apr 23 03:53:15 user devstack@n-api.service[61308]: [pid: 61308|app: 0|req: 102/298] 10.0.0.210 () {62 vars in 1313 bytes} [Sun Apr 23 03:53:15 2023] GET /compute/v2.1/servers/954f41b2-5c67-41a4-b38b-ebf3ad60cac7 => generated 1658 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 23 03:53:31 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi [None req-7d25be1d-39b2-4177-bb48-871cc92ac353 tempest-TestVolumeBootPattern-1795582909 tempest-TestVolumeBootPattern-1795582909-project-member] Action: 'create', calling method: .version_select at 0x7f21e12b11b0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1485060910", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJlu/J4ZurvEmpJnFjp4oU1MVo20sJ9CurK6LzuewBPQSyPJvTFFEv2/zOC8rLfiKWt0qYa4bKy/W6p2JfpjWwSPkGy3iaxjqExrz4hmHKTPSfVfX52fNwG6IUHLRO1Uag=="}} {{(pid=61306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 03:53:31 user devstack@n-api.service[61306]: DEBUG dbcounter [-] [61306] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=61306) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:53:31 user devstack@n-api.service[61306]: DEBUG dbcounter [-] [61306] Writing DB stats nova_cell1:SELECT=6 {{(pid=61306) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:53:31 user devstack@n-api.service[61306]: DEBUG nova.quota [None req-7d25be1d-39b2-4177-bb48-871cc92ac353 tempest-TestVolumeBootPattern-1795582909 tempest-TestVolumeBootPattern-1795582909-project-member] Getting quotas for project acb58a653b73497f8f89b40665212ab0. Resources: {'key_pairs'} {{(pid=61306) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 23 03:53:31 user devstack@n-api.service[61306]: DEBUG nova.quota [None req-7d25be1d-39b2-4177-bb48-871cc92ac353 tempest-TestVolumeBootPattern-1795582909 tempest-TestVolumeBootPattern-1795582909-project-member] Getting quotas for user b070f9471fbc4426bf66406adf714b9f and project acb58a653b73497f8f89b40665212ab0. Resources: {'key_pairs'} {{(pid=61306) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 23 03:53:31 user devstack@n-api.service[61306]: INFO nova.api.openstack.requestlog [None req-7d25be1d-39b2-4177-bb48-871cc92ac353 tempest-TestVolumeBootPattern-1795582909 tempest-TestVolumeBootPattern-1795582909-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.055813 Apr 23 03:53:31 user devstack@n-api.service[61306]: [pid: 61306|app: 0|req: 98/299] 10.0.0.210 () {64 vars in 1236 bytes} [Sun Apr 23 03:53:31 2023] POST /compute/v2.1/os-keypairs => generated 400 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 23 03:53:34 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi [None req-28fb6552-6cd1-448b-8721-27dfa2e33d9d tempest-TestVolumeBootPattern-1795582909 tempest-TestVolumeBootPattern-1795582909-project-member] Calling method '.version_select at 0x7f21e10cf7f0>' {{(pid=61307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 03:53:34 user devstack@n-api.service[61307]: DEBUG dbcounter [-] [61307] Writing DB stats nova_api:SELECT=26,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=61307) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:53:34 user devstack@n-api.service[61307]: DEBUG dbcounter [-] [61307] Writing DB stats nova_cell1:SELECT=41,nova_cell1:UPDATE=17,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2,nova_cell1:INSERT=1 {{(pid=61307) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:53:34 user devstack@n-api.service[61307]: INFO nova.api.openstack.requestlog [None req-28fb6552-6cd1-448b-8721-27dfa2e33d9d tempest-TestVolumeBootPattern-1795582909 tempest-TestVolumeBootPattern-1795582909-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1485060910" status: 202 len: 0 microversion: 2.1 time: 0.027897 Apr 23 03:53:34 user devstack@n-api.service[61307]: [pid: 61307|app: 0|req: 100/300] 10.0.0.210 () {62 vars in 1340 bytes} [Sun Apr 23 03:53:34 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1485060910 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 23 03:53:41 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi [None req-37461c6f-5bd3-4992-920d-2f65df3c8d18 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Calling method '>' {{(pid=61308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 03:53:41 user devstack@n-api.service[61308]: DEBUG nova.compute.api [None req-37461c6f-5bd3-4992-920d-2f65df3c8d18 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] [instance: c21ec3a3-0761-4543-ad43-dca2913d159b] Fetching instance by UUID {{(pid=61308) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 23 03:53:41 user devstack@n-api.service[61308]: DEBUG dbcounter [-] [61308] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=61308) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:53:41 user devstack@n-api.service[61308]: DEBUG dbcounter [-] [61308] Writing DB stats nova_cell1:SELECT=22 {{(pid=61308) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:53:41 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-37461c6f-5bd3-4992-920d-2f65df3c8d18 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:53:41 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-37461c6f-5bd3-4992-920d-2f65df3c8d18 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:53:41 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-37461c6f-5bd3-4992-920d-2f65df3c8d18 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:53:41 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-37461c6f-5bd3-4992-920d-2f65df3c8d18 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:53:41 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-37461c6f-5bd3-4992-920d-2f65df3c8d18 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:53:41 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-37461c6f-5bd3-4992-920d-2f65df3c8d18 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:53:41 user devstack@n-api.service[61308]: DEBUG nova.policy [None req-37461c6f-5bd3-4992-920d-2f65df3c8d18 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2c459cad014b07b2613e5e261d88aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24fff486a500421397ecb935828582cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61308) authorize /opt/stack/nova/nova/policy.py:203}} Apr 23 03:53:41 user devstack@n-api.service[61308]: INFO nova.api.openstack.requestlog [None req-37461c6f-5bd3-4992-920d-2f65df3c8d18 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c21ec3a3-0761-4543-ad43-dca2913d159b" status: 200 len: 1542 microversion: 2.1 time: 0.275933 Apr 23 03:53:41 user devstack@n-api.service[61308]: [pid: 61308|app: 0|req: 103/301] 10.0.0.210 () {62 vars in 1313 bytes} [Sun Apr 23 03:53:41 2023] GET /compute/v2.1/servers/c21ec3a3-0761-4543-ad43-dca2913d159b => generated 1542 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 23 03:53:48 user devstack@n-api.service[61306]: DEBUG dbcounter [-] [61306] Writing DB stats nova_cell0:SELECT=4 {{(pid=61306) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:53:48 user devstack@n-api.service[61306]: DEBUG dbcounter [-] [61306] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=61306) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:53:48 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi [None req-3181a7f7-c027-4ac5-8e24-d58053bcb84d tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Calling method '>' {{(pid=61306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 03:53:48 user devstack@n-api.service[61306]: DEBUG nova.compute.api [None req-3181a7f7-c027-4ac5-8e24-d58053bcb84d tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] [instance: 97b28eb9-634c-4f9b-97ef-41d9f45f19b7] Fetching instance by UUID {{(pid=61306) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 23 03:53:48 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-3181a7f7-c027-4ac5-8e24-d58053bcb84d tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:53:48 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-3181a7f7-c027-4ac5-8e24-d58053bcb84d tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:53:48 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-3181a7f7-c027-4ac5-8e24-d58053bcb84d tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:53:48 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-3181a7f7-c027-4ac5-8e24-d58053bcb84d tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:53:48 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-3181a7f7-c027-4ac5-8e24-d58053bcb84d tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:53:48 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-3181a7f7-c027-4ac5-8e24-d58053bcb84d tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:53:49 user devstack@n-api.service[61306]: DEBUG nova.policy [None req-3181a7f7-c027-4ac5-8e24-d58053bcb84d tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99495726467944c38620831fc93e2856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79e09b1c4ae4cc5ab11c3e56ee4f0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61306) authorize /opt/stack/nova/nova/policy.py:203}} Apr 23 03:53:49 user devstack@n-api.service[61306]: DEBUG nova.policy [None req-3181a7f7-c027-4ac5-8e24-d58053bcb84d tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99495726467944c38620831fc93e2856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79e09b1c4ae4cc5ab11c3e56ee4f0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61306) authorize /opt/stack/nova/nova/policy.py:203}} Apr 23 03:53:49 user devstack@n-api.service[61306]: DEBUG nova.policy [None req-3181a7f7-c027-4ac5-8e24-d58053bcb84d tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99495726467944c38620831fc93e2856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79e09b1c4ae4cc5ab11c3e56ee4f0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61306) authorize /opt/stack/nova/nova/policy.py:203}} Apr 23 03:53:49 user devstack@n-api.service[61306]: INFO nova.api.openstack.requestlog [None req-3181a7f7-c027-4ac5-8e24-d58053bcb84d tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] 10.0.0.210 "GET /compute/v2.1/servers/97b28eb9-634c-4f9b-97ef-41d9f45f19b7" status: 200 len: 1691 microversion: 2.87 time: 0.261334 Apr 23 03:53:49 user devstack@n-api.service[61306]: [pid: 61306|app: 0|req: 99/302] 10.0.0.210 () {64 vars in 1354 bytes} [Sun Apr 23 03:53:48 2023] GET /compute/v2.1/servers/97b28eb9-634c-4f9b-97ef-41d9f45f19b7 => generated 1691 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 23 03:54:08 user devstack@n-api.service[61307]: DEBUG dbcounter [-] [61307] Writing DB stats nova_api:SELECT=3,nova_api:DELETE=1 {{(pid=61307) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:54:08 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi [None req-5e1dca6a-52fe-4724-a03c-b7cfd9f25e9c tempest-VolumesActionsTest-911298328 tempest-VolumesActionsTest-911298328-project-member] Calling method '>' {{(pid=61307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 03:54:08 user devstack@n-api.service[61307]: DEBUG nova.compute.api [None req-5e1dca6a-52fe-4724-a03c-b7cfd9f25e9c tempest-VolumesActionsTest-911298328 tempest-VolumesActionsTest-911298328-project-member] [instance: 39775e82-0123-41cf-ad97-d3865a796828] Fetching instance by UUID {{(pid=61307) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 23 03:54:08 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-5e1dca6a-52fe-4724-a03c-b7cfd9f25e9c tempest-VolumesActionsTest-911298328 tempest-VolumesActionsTest-911298328-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:54:08 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-5e1dca6a-52fe-4724-a03c-b7cfd9f25e9c tempest-VolumesActionsTest-911298328 tempest-VolumesActionsTest-911298328-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:54:08 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-5e1dca6a-52fe-4724-a03c-b7cfd9f25e9c tempest-VolumesActionsTest-911298328 tempest-VolumesActionsTest-911298328-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:54:08 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-5e1dca6a-52fe-4724-a03c-b7cfd9f25e9c tempest-VolumesActionsTest-911298328 tempest-VolumesActionsTest-911298328-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:54:08 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-5e1dca6a-52fe-4724-a03c-b7cfd9f25e9c tempest-VolumesActionsTest-911298328 tempest-VolumesActionsTest-911298328-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:54:08 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-5e1dca6a-52fe-4724-a03c-b7cfd9f25e9c tempest-VolumesActionsTest-911298328 tempest-VolumesActionsTest-911298328-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:54:08 user devstack@n-api.service[61307]: DEBUG nova.compute.api [None req-5e1dca6a-52fe-4724-a03c-b7cfd9f25e9c tempest-VolumesActionsTest-911298328 tempest-VolumesActionsTest-911298328-project-member] [instance: 39775e82-0123-41cf-ad97-d3865a796828] Going to try to terminate instance {{(pid=61307) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 23 03:54:08 user devstack@n-api.service[61307]: INFO nova.api.openstack.requestlog [None req-5e1dca6a-52fe-4724-a03c-b7cfd9f25e9c tempest-VolumesActionsTest-911298328 tempest-VolumesActionsTest-911298328-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/39775e82-0123-41cf-ad97-d3865a796828" status: 204 len: 0 microversion: 2.1 time: 0.126639 Apr 23 03:54:08 user devstack@n-api.service[61307]: [pid: 61307|app: 0|req: 101/303] 10.0.0.210 () {62 vars in 1316 bytes} [Sun Apr 23 03:54:08 2023] DELETE /compute/v2.1/servers/39775e82-0123-41cf-ad97-d3865a796828 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 23 03:54:08 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi [None req-7c6e14b0-755c-4084-bc02-c4ba1e898644 tempest-VolumesActionsTest-911298328 tempest-VolumesActionsTest-911298328-project-member] Calling method '>' {{(pid=61308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 03:54:08 user devstack@n-api.service[61308]: DEBUG nova.compute.api [None req-7c6e14b0-755c-4084-bc02-c4ba1e898644 tempest-VolumesActionsTest-911298328 tempest-VolumesActionsTest-911298328-project-member] [instance: 39775e82-0123-41cf-ad97-d3865a796828] Fetching instance by UUID {{(pid=61308) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 23 03:54:08 user devstack@n-api.service[61308]: DEBUG dbcounter [-] [61308] Writing DB stats nova_api:SELECT=2 {{(pid=61308) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:54:08 user devstack@n-api.service[61308]: DEBUG dbcounter [-] [61308] Writing DB stats nova_cell1:SELECT=6 {{(pid=61308) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:54:08 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-7c6e14b0-755c-4084-bc02-c4ba1e898644 tempest-VolumesActionsTest-911298328 tempest-VolumesActionsTest-911298328-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:54:08 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-7c6e14b0-755c-4084-bc02-c4ba1e898644 tempest-VolumesActionsTest-911298328 tempest-VolumesActionsTest-911298328-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:54:08 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-7c6e14b0-755c-4084-bc02-c4ba1e898644 tempest-VolumesActionsTest-911298328 tempest-VolumesActionsTest-911298328-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:54:08 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-7c6e14b0-755c-4084-bc02-c4ba1e898644 tempest-VolumesActionsTest-911298328 tempest-VolumesActionsTest-911298328-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:54:08 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-7c6e14b0-755c-4084-bc02-c4ba1e898644 tempest-VolumesActionsTest-911298328 tempest-VolumesActionsTest-911298328-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:54:08 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-7c6e14b0-755c-4084-bc02-c4ba1e898644 tempest-VolumesActionsTest-911298328 tempest-VolumesActionsTest-911298328-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:54:08 user devstack@n-api.service[61308]: DEBUG nova.policy [None req-7c6e14b0-755c-4084-bc02-c4ba1e898644 tempest-VolumesActionsTest-911298328 tempest-VolumesActionsTest-911298328-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405152a49bf14ad68f5c96f767c70b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '037d3963711a4727a4def98cfff4da67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61308) authorize /opt/stack/nova/nova/policy.py:203}} Apr 23 03:54:08 user devstack@n-api.service[61308]: INFO nova.api.openstack.requestlog [None req-7c6e14b0-755c-4084-bc02-c4ba1e898644 tempest-VolumesActionsTest-911298328 tempest-VolumesActionsTest-911298328-project-member] 10.0.0.210 "GET /compute/v2.1/servers/39775e82-0123-41cf-ad97-d3865a796828" status: 200 len: 1491 microversion: 2.1 time: 0.325460 Apr 23 03:54:08 user devstack@n-api.service[61308]: [pid: 61308|app: 0|req: 104/304] 10.0.0.210 () {62 vars in 1313 bytes} [Sun Apr 23 03:54:08 2023] GET /compute/v2.1/servers/39775e82-0123-41cf-ad97-d3865a796828 => generated 1491 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 23 03:54:08 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi [req-8ac0c576-a104-4a6c-8df1-bb72756cae49 req-54a0ae2a-f976-41de-bd65-fc93980d7280 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39775e82-0123-41cf-ad97-d3865a796828", "name": "network-vif-unplugged", "status": "completed", "tag": "83fd1d96-1b09-4965-9a3b-a362e9ffc06e"}]} {{(pid=61306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 03:54:08 user devstack@n-api.service[61306]: DEBUG dbcounter [-] [61306] Writing DB stats nova_cell1:SELECT=6 {{(pid=61306) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:54:08 user devstack@n-api.service[61306]: DEBUG dbcounter [-] [61306] Writing DB stats nova_api:SELECT=4 {{(pid=61306) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:54:08 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [req-8ac0c576-a104-4a6c-8df1-bb72756cae49 req-54a0ae2a-f976-41de-bd65-fc93980d7280 service nova] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:54:08 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [req-8ac0c576-a104-4a6c-8df1-bb72756cae49 req-54a0ae2a-f976-41de-bd65-fc93980d7280 service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:54:08 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [req-8ac0c576-a104-4a6c-8df1-bb72756cae49 req-54a0ae2a-f976-41de-bd65-fc93980d7280 service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:54:08 user devstack@n-api.service[61306]: INFO nova.api.openstack.compute.server_external_events [req-8ac0c576-a104-4a6c-8df1-bb72756cae49 req-54a0ae2a-f976-41de-bd65-fc93980d7280 service nova] Creating event network-vif-unplugged:83fd1d96-1b09-4965-9a3b-a362e9ffc06e for instance 39775e82-0123-41cf-ad97-d3865a796828 on user Apr 23 03:54:08 user devstack@n-api.service[61306]: INFO nova.api.openstack.requestlog [req-8ac0c576-a104-4a6c-8df1-bb72756cae49 req-54a0ae2a-f976-41de-bd65-fc93980d7280 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030368 Apr 23 03:54:08 user devstack@n-api.service[61306]: [pid: 61306|app: 0|req: 100/305] 10.0.0.210 () {68 vars in 1394 bytes} [Sun Apr 23 03:54:08 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 23 03:54:09 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi [req-0ad2d0cb-c2d2-4ba5-850a-093b36c41505 req-f09fd772-45b4-4240-899e-7967b08eb091 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39775e82-0123-41cf-ad97-d3865a796828", "name": "network-vif-deleted", "tag": "83fd1d96-1b09-4965-9a3b-a362e9ffc06e"}]} {{(pid=61307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 03:54:09 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [req-0ad2d0cb-c2d2-4ba5-850a-093b36c41505 req-f09fd772-45b4-4240-899e-7967b08eb091 service nova] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:54:09 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [req-0ad2d0cb-c2d2-4ba5-850a-093b36c41505 req-f09fd772-45b4-4240-899e-7967b08eb091 service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:54:09 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [req-0ad2d0cb-c2d2-4ba5-850a-093b36c41505 req-f09fd772-45b4-4240-899e-7967b08eb091 service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:54:09 user devstack@n-api.service[61307]: INFO nova.api.openstack.compute.server_external_events [req-0ad2d0cb-c2d2-4ba5-850a-093b36c41505 req-f09fd772-45b4-4240-899e-7967b08eb091 service nova] Creating event network-vif-deleted:83fd1d96-1b09-4965-9a3b-a362e9ffc06e for instance 39775e82-0123-41cf-ad97-d3865a796828 on user Apr 23 03:54:09 user devstack@n-api.service[61307]: INFO nova.api.openstack.requestlog [req-0ad2d0cb-c2d2-4ba5-850a-093b36c41505 req-f09fd772-45b4-4240-899e-7967b08eb091 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030562 Apr 23 03:54:09 user devstack@n-api.service[61307]: [pid: 61307|app: 0|req: 102/306] 10.0.0.210 () {68 vars in 1394 bytes} [Sun Apr 23 03:54:09 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 23 03:54:10 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi [req-9664da0e-a0a3-4391-bd1d-fa1cef4e8253 req-b49b525a-926d-473a-bc7b-032497a90e43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39775e82-0123-41cf-ad97-d3865a796828", "name": "network-vif-plugged", "status": "completed", "tag": "83fd1d96-1b09-4965-9a3b-a362e9ffc06e"}]} {{(pid=61308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 03:54:10 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [req-9664da0e-a0a3-4391-bd1d-fa1cef4e8253 req-b49b525a-926d-473a-bc7b-032497a90e43 service nova] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:54:10 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [req-9664da0e-a0a3-4391-bd1d-fa1cef4e8253 req-b49b525a-926d-473a-bc7b-032497a90e43 service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:54:10 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [req-9664da0e-a0a3-4391-bd1d-fa1cef4e8253 req-b49b525a-926d-473a-bc7b-032497a90e43 service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:54:10 user devstack@n-api.service[61308]: INFO nova.api.openstack.compute.server_external_events [req-9664da0e-a0a3-4391-bd1d-fa1cef4e8253 req-b49b525a-926d-473a-bc7b-032497a90e43 service nova] Creating event network-vif-plugged:83fd1d96-1b09-4965-9a3b-a362e9ffc06e for instance 39775e82-0123-41cf-ad97-d3865a796828 on user Apr 23 03:54:10 user devstack@n-api.service[61308]: INFO nova.api.openstack.requestlog [req-9664da0e-a0a3-4391-bd1d-fa1cef4e8253 req-b49b525a-926d-473a-bc7b-032497a90e43 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028939 Apr 23 03:54:10 user devstack@n-api.service[61308]: [pid: 61308|app: 0|req: 105/307] 10.0.0.210 () {68 vars in 1394 bytes} [Sun Apr 23 03:54:10 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 23 03:54:17 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi [None req-5f725606-b3e3-4ca9-a1e5-b8226ae50436 tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] Calling method '>' {{(pid=61306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 03:54:17 user devstack@n-api.service[61306]: DEBUG nova.compute.api [None req-5f725606-b3e3-4ca9-a1e5-b8226ae50436 tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] [instance: 954f41b2-5c67-41a4-b38b-ebf3ad60cac7] Fetching instance by UUID {{(pid=61306) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 23 03:54:17 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-5f725606-b3e3-4ca9-a1e5-b8226ae50436 tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:54:17 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-5f725606-b3e3-4ca9-a1e5-b8226ae50436 tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:54:17 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-5f725606-b3e3-4ca9-a1e5-b8226ae50436 tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:54:17 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-5f725606-b3e3-4ca9-a1e5-b8226ae50436 tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:54:17 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-5f725606-b3e3-4ca9-a1e5-b8226ae50436 tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:54:17 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-5f725606-b3e3-4ca9-a1e5-b8226ae50436 tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:54:17 user devstack@n-api.service[61306]: DEBUG nova.policy [None req-5f725606-b3e3-4ca9-a1e5-b8226ae50436 tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdc8fe94058c46c28d4b3f16dc1e77ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f44fe9ba07e4e2f925d1a8952356e04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61306) authorize /opt/stack/nova/nova/policy.py:203}} Apr 23 03:54:17 user devstack@n-api.service[61306]: INFO nova.api.openstack.requestlog [None req-5f725606-b3e3-4ca9-a1e5-b8226ae50436 tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] 10.0.0.210 "GET /compute/v2.1/servers/954f41b2-5c67-41a4-b38b-ebf3ad60cac7" status: 200 len: 1658 microversion: 2.1 time: 0.213612 Apr 23 03:54:17 user devstack@n-api.service[61306]: [pid: 61306|app: 0|req: 101/308] 10.0.0.210 () {62 vars in 1313 bytes} [Sun Apr 23 03:54:17 2023] GET /compute/v2.1/servers/954f41b2-5c67-41a4-b38b-ebf3ad60cac7 => generated 1658 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 23 03:54:41 user devstack@n-api.service[61307]: DEBUG dbcounter [-] [61307] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61307) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:54:41 user devstack@n-api.service[61307]: DEBUG dbcounter [-] [61307] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61307) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:54:41 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi [None req-9ab2ddc0-4714-4603-a58d-d31b00af5181 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Calling method '>' {{(pid=61307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 03:54:41 user devstack@n-api.service[61307]: DEBUG nova.compute.api [None req-9ab2ddc0-4714-4603-a58d-d31b00af5181 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] [instance: c21ec3a3-0761-4543-ad43-dca2913d159b] Fetching instance by UUID {{(pid=61307) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 23 03:54:41 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-9ab2ddc0-4714-4603-a58d-d31b00af5181 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:54:41 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-9ab2ddc0-4714-4603-a58d-d31b00af5181 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:54:41 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-9ab2ddc0-4714-4603-a58d-d31b00af5181 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:54:41 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-9ab2ddc0-4714-4603-a58d-d31b00af5181 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:54:41 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-9ab2ddc0-4714-4603-a58d-d31b00af5181 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:54:41 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-9ab2ddc0-4714-4603-a58d-d31b00af5181 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:54:41 user devstack@n-api.service[61307]: INFO nova.api.openstack.requestlog [None req-9ab2ddc0-4714-4603-a58d-d31b00af5181 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c21ec3a3-0761-4543-ad43-dca2913d159b/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.178609 Apr 23 03:54:41 user devstack@n-api.service[61307]: [pid: 61307|app: 0|req: 103/309] 10.0.0.210 () {62 vars in 1352 bytes} [Sun Apr 23 03:54:41 2023] GET /compute/v2.1/servers/c21ec3a3-0761-4543-ad43-dca2913d159b/os-interface => generated 282 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 23 03:54:42 user devstack@n-api.service[61308]: DEBUG dbcounter [-] [61308] Writing DB stats nova_api:SELECT=4 {{(pid=61308) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:54:42 user devstack@n-api.service[61308]: DEBUG dbcounter [-] [61308] Writing DB stats nova_cell1:SELECT=8 {{(pid=61308) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:54:42 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi [req-db7d8669-aa3d-4869-88f7-b4b3d2e48876 req-20600193-58cf-4e6d-94cd-869768c9ba96 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c21ec3a3-0761-4543-ad43-dca2913d159b", "tag": "3cc621aa-a5f6-46de-bfd8-32dada7ca345"}]} {{(pid=61308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 03:54:42 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [req-db7d8669-aa3d-4869-88f7-b4b3d2e48876 req-20600193-58cf-4e6d-94cd-869768c9ba96 service nova] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:54:42 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [req-db7d8669-aa3d-4869-88f7-b4b3d2e48876 req-20600193-58cf-4e6d-94cd-869768c9ba96 service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:54:42 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [req-db7d8669-aa3d-4869-88f7-b4b3d2e48876 req-20600193-58cf-4e6d-94cd-869768c9ba96 service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:54:42 user devstack@n-api.service[61308]: INFO nova.api.openstack.compute.server_external_events [req-db7d8669-aa3d-4869-88f7-b4b3d2e48876 req-20600193-58cf-4e6d-94cd-869768c9ba96 service nova] Creating event network-changed:3cc621aa-a5f6-46de-bfd8-32dada7ca345 for instance c21ec3a3-0761-4543-ad43-dca2913d159b on user Apr 23 03:54:42 user devstack@n-api.service[61308]: INFO nova.api.openstack.requestlog [req-db7d8669-aa3d-4869-88f7-b4b3d2e48876 req-20600193-58cf-4e6d-94cd-869768c9ba96 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036653 Apr 23 03:54:42 user devstack@n-api.service[61308]: [pid: 61308|app: 0|req: 106/310] 10.0.0.210 () {68 vars in 1394 bytes} [Sun Apr 23 03:54:42 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 23 03:54:42 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi [None req-e7f627a6-ed86-49cc-a065-c9dab98492b2 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Calling method '>' {{(pid=61306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 03:54:42 user devstack@n-api.service[61306]: DEBUG nova.compute.api [None req-e7f627a6-ed86-49cc-a065-c9dab98492b2 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] [instance: c21ec3a3-0761-4543-ad43-dca2913d159b] Fetching instance by UUID {{(pid=61306) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 23 03:54:42 user devstack@n-api.service[61306]: DEBUG dbcounter [-] [61306] Writing DB stats nova_api:SELECT=4 {{(pid=61306) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:54:42 user devstack@n-api.service[61306]: DEBUG dbcounter [-] [61306] Writing DB stats nova_cell1:SELECT=8 {{(pid=61306) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:54:42 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-e7f627a6-ed86-49cc-a065-c9dab98492b2 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:54:42 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-e7f627a6-ed86-49cc-a065-c9dab98492b2 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:54:42 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-e7f627a6-ed86-49cc-a065-c9dab98492b2 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:54:42 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-e7f627a6-ed86-49cc-a065-c9dab98492b2 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:54:42 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-e7f627a6-ed86-49cc-a065-c9dab98492b2 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:54:42 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-e7f627a6-ed86-49cc-a065-c9dab98492b2 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:54:42 user devstack@n-api.service[61306]: INFO nova.api.openstack.requestlog [None req-e7f627a6-ed86-49cc-a065-c9dab98492b2 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c21ec3a3-0761-4543-ad43-dca2913d159b/ips" status: 200 len: 107 microversion: 2.1 time: 0.038825 Apr 23 03:54:42 user devstack@n-api.service[61306]: [pid: 61306|app: 0|req: 102/311] 10.0.0.210 () {62 vars in 1325 bytes} [Sun Apr 23 03:54:42 2023] GET /compute/v2.1/servers/c21ec3a3-0761-4543-ad43-dca2913d159b/ips => generated 107 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 23 03:54:44 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi [None req-b04a8a65-28ce-46b7-8c67-fd9c7f298b50 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Calling method '>' {{(pid=61307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 03:54:44 user devstack@n-api.service[61307]: DEBUG nova.compute.api [None req-b04a8a65-28ce-46b7-8c67-fd9c7f298b50 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] [instance: c21ec3a3-0761-4543-ad43-dca2913d159b] Fetching instance by UUID {{(pid=61307) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 23 03:54:44 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-b04a8a65-28ce-46b7-8c67-fd9c7f298b50 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:54:44 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-b04a8a65-28ce-46b7-8c67-fd9c7f298b50 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:54:44 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-b04a8a65-28ce-46b7-8c67-fd9c7f298b50 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:54:44 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-b04a8a65-28ce-46b7-8c67-fd9c7f298b50 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:54:44 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-b04a8a65-28ce-46b7-8c67-fd9c7f298b50 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:54:44 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-b04a8a65-28ce-46b7-8c67-fd9c7f298b50 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:54:44 user devstack@n-api.service[61307]: DEBUG nova.compute.api [None req-b04a8a65-28ce-46b7-8c67-fd9c7f298b50 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] [instance: c21ec3a3-0761-4543-ad43-dca2913d159b] Going to try to terminate instance {{(pid=61307) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 23 03:54:44 user devstack@n-api.service[61307]: INFO nova.api.openstack.requestlog [None req-b04a8a65-28ce-46b7-8c67-fd9c7f298b50 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/c21ec3a3-0761-4543-ad43-dca2913d159b" status: 204 len: 0 microversion: 2.1 time: 0.116145 Apr 23 03:54:44 user devstack@n-api.service[61307]: [pid: 61307|app: 0|req: 104/312] 10.0.0.210 () {62 vars in 1316 bytes} [Sun Apr 23 03:54:44 2023] DELETE /compute/v2.1/servers/c21ec3a3-0761-4543-ad43-dca2913d159b => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 23 03:54:44 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi [None req-dc7fc9db-7591-4b2f-89f1-ecadb2e61698 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Calling method '>' {{(pid=61308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 03:54:44 user devstack@n-api.service[61308]: DEBUG nova.compute.api [None req-dc7fc9db-7591-4b2f-89f1-ecadb2e61698 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] [instance: c21ec3a3-0761-4543-ad43-dca2913d159b] Fetching instance by UUID {{(pid=61308) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 23 03:54:44 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-dc7fc9db-7591-4b2f-89f1-ecadb2e61698 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:54:44 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-dc7fc9db-7591-4b2f-89f1-ecadb2e61698 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:54:44 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-dc7fc9db-7591-4b2f-89f1-ecadb2e61698 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:54:44 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-dc7fc9db-7591-4b2f-89f1-ecadb2e61698 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:54:44 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-dc7fc9db-7591-4b2f-89f1-ecadb2e61698 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:54:44 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-dc7fc9db-7591-4b2f-89f1-ecadb2e61698 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:54:44 user devstack@n-api.service[61308]: DEBUG nova.policy [None req-dc7fc9db-7591-4b2f-89f1-ecadb2e61698 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2c459cad014b07b2613e5e261d88aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24fff486a500421397ecb935828582cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61308) authorize /opt/stack/nova/nova/policy.py:203}} Apr 23 03:54:44 user devstack@n-api.service[61308]: INFO nova.api.openstack.requestlog [None req-dc7fc9db-7591-4b2f-89f1-ecadb2e61698 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c21ec3a3-0761-4543-ad43-dca2913d159b" status: 200 len: 1667 microversion: 2.1 time: 0.263061 Apr 23 03:54:44 user devstack@n-api.service[61308]: [pid: 61308|app: 0|req: 107/313] 10.0.0.210 () {62 vars in 1313 bytes} [Sun Apr 23 03:54:44 2023] GET /compute/v2.1/servers/c21ec3a3-0761-4543-ad43-dca2913d159b => generated 1667 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 23 03:54:44 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi [req-f8307e94-0a11-4f98-8a96-88c15a4f34b2 req-e0bbd537-cc57-42ba-b402-4965baa1d86f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c21ec3a3-0761-4543-ad43-dca2913d159b", "name": "network-vif-unplugged", "status": "completed", "tag": "3cc621aa-a5f6-46de-bfd8-32dada7ca345"}]} {{(pid=61306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 03:54:44 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [req-f8307e94-0a11-4f98-8a96-88c15a4f34b2 req-e0bbd537-cc57-42ba-b402-4965baa1d86f service nova] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:54:44 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [req-f8307e94-0a11-4f98-8a96-88c15a4f34b2 req-e0bbd537-cc57-42ba-b402-4965baa1d86f service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:54:44 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [req-f8307e94-0a11-4f98-8a96-88c15a4f34b2 req-e0bbd537-cc57-42ba-b402-4965baa1d86f service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:54:44 user devstack@n-api.service[61306]: INFO nova.api.openstack.compute.server_external_events [req-f8307e94-0a11-4f98-8a96-88c15a4f34b2 req-e0bbd537-cc57-42ba-b402-4965baa1d86f service nova] Creating event network-vif-unplugged:3cc621aa-a5f6-46de-bfd8-32dada7ca345 for instance c21ec3a3-0761-4543-ad43-dca2913d159b on user Apr 23 03:54:44 user devstack@n-api.service[61306]: INFO nova.api.openstack.requestlog [req-f8307e94-0a11-4f98-8a96-88c15a4f34b2 req-e0bbd537-cc57-42ba-b402-4965baa1d86f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029873 Apr 23 03:54:44 user devstack@n-api.service[61306]: [pid: 61306|app: 0|req: 103/314] 10.0.0.210 () {68 vars in 1394 bytes} [Sun Apr 23 03:54:44 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 23 03:54:46 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi [req-6510ea6f-1d62-49ff-bcc5-e0bcb4aa8d8a req-67f75e95-96aa-4b44-9332-9b69ec436acd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c21ec3a3-0761-4543-ad43-dca2913d159b", "name": "network-vif-deleted", "tag": "3cc621aa-a5f6-46de-bfd8-32dada7ca345"}]} {{(pid=61307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 03:54:46 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [req-6510ea6f-1d62-49ff-bcc5-e0bcb4aa8d8a req-67f75e95-96aa-4b44-9332-9b69ec436acd service nova] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:54:46 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [req-6510ea6f-1d62-49ff-bcc5-e0bcb4aa8d8a req-67f75e95-96aa-4b44-9332-9b69ec436acd service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:54:46 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [req-6510ea6f-1d62-49ff-bcc5-e0bcb4aa8d8a req-67f75e95-96aa-4b44-9332-9b69ec436acd service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:54:46 user devstack@n-api.service[61307]: INFO nova.api.openstack.compute.server_external_events [req-6510ea6f-1d62-49ff-bcc5-e0bcb4aa8d8a req-67f75e95-96aa-4b44-9332-9b69ec436acd service nova] Creating event network-vif-deleted:3cc621aa-a5f6-46de-bfd8-32dada7ca345 for instance c21ec3a3-0761-4543-ad43-dca2913d159b on user Apr 23 03:54:46 user devstack@n-api.service[61307]: INFO nova.api.openstack.requestlog [req-6510ea6f-1d62-49ff-bcc5-e0bcb4aa8d8a req-67f75e95-96aa-4b44-9332-9b69ec436acd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028468 Apr 23 03:54:46 user devstack@n-api.service[61307]: [pid: 61307|app: 0|req: 105/315] 10.0.0.210 () {68 vars in 1394 bytes} [Sun Apr 23 03:54:46 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 23 03:54:46 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi [req-639c1637-b853-44ab-abc5-8b324bfe76fc req-228f655a-d9de-4628-a06f-920532afb42e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c21ec3a3-0761-4543-ad43-dca2913d159b", "name": "network-vif-plugged", "status": "completed", "tag": "3cc621aa-a5f6-46de-bfd8-32dada7ca345"}]} {{(pid=61308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 03:54:46 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [req-639c1637-b853-44ab-abc5-8b324bfe76fc req-228f655a-d9de-4628-a06f-920532afb42e service nova] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:54:46 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [req-639c1637-b853-44ab-abc5-8b324bfe76fc req-228f655a-d9de-4628-a06f-920532afb42e service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:54:46 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [req-639c1637-b853-44ab-abc5-8b324bfe76fc req-228f655a-d9de-4628-a06f-920532afb42e service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:54:46 user devstack@n-api.service[61308]: INFO nova.api.openstack.compute.server_external_events [req-639c1637-b853-44ab-abc5-8b324bfe76fc req-228f655a-d9de-4628-a06f-920532afb42e service nova] Creating event network-vif-plugged:3cc621aa-a5f6-46de-bfd8-32dada7ca345 for instance c21ec3a3-0761-4543-ad43-dca2913d159b on user Apr 23 03:54:46 user devstack@n-api.service[61308]: INFO nova.api.openstack.requestlog [req-639c1637-b853-44ab-abc5-8b324bfe76fc req-228f655a-d9de-4628-a06f-920532afb42e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031117 Apr 23 03:54:46 user devstack@n-api.service[61308]: [pid: 61308|app: 0|req: 108/316] 10.0.0.210 () {68 vars in 1394 bytes} [Sun Apr 23 03:54:46 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 23 03:54:49 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi [None req-a0e9a895-79cc-4bcd-a4e9-872d1a118eb6 tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerBootFromVolumeStableRescueTest-image-1830201751"}} {{(pid=61306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 03:54:49 user devstack@n-api.service[61306]: DEBUG nova.compute.api [None req-a0e9a895-79cc-4bcd-a4e9-872d1a118eb6 tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] [instance: 97b28eb9-634c-4f9b-97ef-41d9f45f19b7] Fetching instance by UUID {{(pid=61306) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 23 03:54:49 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-a0e9a895-79cc-4bcd-a4e9-872d1a118eb6 tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:54:49 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-a0e9a895-79cc-4bcd-a4e9-872d1a118eb6 tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:54:49 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-a0e9a895-79cc-4bcd-a4e9-872d1a118eb6 tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:54:49 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-a0e9a895-79cc-4bcd-a4e9-872d1a118eb6 tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:54:49 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-a0e9a895-79cc-4bcd-a4e9-872d1a118eb6 tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:54:49 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-a0e9a895-79cc-4bcd-a4e9-872d1a118eb6 tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:54:50 user devstack@n-api.service[61306]: INFO nova.api.openstack.requestlog [None req-a0e9a895-79cc-4bcd-a4e9-872d1a118eb6 tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] 10.0.0.210 "POST /compute/v2.1/servers/97b28eb9-634c-4f9b-97ef-41d9f45f19b7/action" status: 202 len: 52 microversion: 2.87 time: 0.986183 Apr 23 03:54:50 user devstack@n-api.service[61306]: [pid: 61306|app: 0|req: 104/317] 10.0.0.210 () {66 vars in 1396 bytes} [Sun Apr 23 03:54:49 2023] POST /compute/v2.1/servers/97b28eb9-634c-4f9b-97ef-41d9f45f19b7/action => generated 52 bytes in 988 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Apr 23 03:54:55 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi [None req-6af4a9f8-52a0-47ae-8be5-241ed96a39ee tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Calling method '>' {{(pid=61307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 03:54:55 user devstack@n-api.service[61307]: DEBUG nova.compute.api [None req-6af4a9f8-52a0-47ae-8be5-241ed96a39ee tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] [instance: 97b28eb9-634c-4f9b-97ef-41d9f45f19b7] Fetching instance by UUID {{(pid=61307) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 23 03:54:55 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-6af4a9f8-52a0-47ae-8be5-241ed96a39ee tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:54:55 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-6af4a9f8-52a0-47ae-8be5-241ed96a39ee tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:54:55 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-6af4a9f8-52a0-47ae-8be5-241ed96a39ee tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:54:55 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-6af4a9f8-52a0-47ae-8be5-241ed96a39ee tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:54:55 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-6af4a9f8-52a0-47ae-8be5-241ed96a39ee tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:54:55 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-6af4a9f8-52a0-47ae-8be5-241ed96a39ee tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:54:55 user devstack@n-api.service[61307]: DEBUG nova.policy [None req-6af4a9f8-52a0-47ae-8be5-241ed96a39ee tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99495726467944c38620831fc93e2856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79e09b1c4ae4cc5ab11c3e56ee4f0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61307) authorize /opt/stack/nova/nova/policy.py:203}} Apr 23 03:54:55 user devstack@n-api.service[61307]: DEBUG nova.policy [None req-6af4a9f8-52a0-47ae-8be5-241ed96a39ee tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99495726467944c38620831fc93e2856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79e09b1c4ae4cc5ab11c3e56ee4f0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61307) authorize /opt/stack/nova/nova/policy.py:203}} Apr 23 03:54:55 user devstack@n-api.service[61307]: DEBUG nova.policy [None req-6af4a9f8-52a0-47ae-8be5-241ed96a39ee tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99495726467944c38620831fc93e2856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79e09b1c4ae4cc5ab11c3e56ee4f0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61307) authorize /opt/stack/nova/nova/policy.py:203}} Apr 23 03:54:55 user devstack@n-api.service[61307]: INFO nova.api.openstack.requestlog [None req-6af4a9f8-52a0-47ae-8be5-241ed96a39ee tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] 10.0.0.210 "GET /compute/v2.1/servers/97b28eb9-634c-4f9b-97ef-41d9f45f19b7" status: 200 len: 1691 microversion: 2.87 time: 0.358293 Apr 23 03:54:55 user devstack@n-api.service[61307]: [pid: 61307|app: 0|req: 106/318] 10.0.0.210 () {64 vars in 1354 bytes} [Sun Apr 23 03:54:55 2023] GET /compute/v2.1/servers/97b28eb9-634c-4f9b-97ef-41d9f45f19b7 => generated 1691 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 23 03:54:58 user devstack@n-api.service[61308]: DEBUG dbcounter [-] [61308] Writing DB stats nova_api:SELECT=6 {{(pid=61308) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:54:58 user devstack@n-api.service[61308]: DEBUG dbcounter [-] [61308] Writing DB stats nova_cell1:SELECT=10 {{(pid=61308) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:54:58 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi [None req-6e27491c-cf16-49e1-89ca-8c9511a163a6 tempest-VolumesActionsTest-911298328 tempest-VolumesActionsTest-911298328-project-member] Calling method '>' {{(pid=61308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 03:54:58 user devstack@n-api.service[61308]: DEBUG nova.compute.api [None req-6e27491c-cf16-49e1-89ca-8c9511a163a6 tempest-VolumesActionsTest-911298328 tempest-VolumesActionsTest-911298328-project-member] [instance: 39775e82-0123-41cf-ad97-d3865a796828] Fetching instance by UUID {{(pid=61308) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 23 03:54:58 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-6e27491c-cf16-49e1-89ca-8c9511a163a6 tempest-VolumesActionsTest-911298328 tempest-VolumesActionsTest-911298328-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:54:58 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-6e27491c-cf16-49e1-89ca-8c9511a163a6 tempest-VolumesActionsTest-911298328 tempest-VolumesActionsTest-911298328-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:54:58 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-6e27491c-cf16-49e1-89ca-8c9511a163a6 tempest-VolumesActionsTest-911298328 tempest-VolumesActionsTest-911298328-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:54:58 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-6e27491c-cf16-49e1-89ca-8c9511a163a6 tempest-VolumesActionsTest-911298328 tempest-VolumesActionsTest-911298328-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:54:58 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-6e27491c-cf16-49e1-89ca-8c9511a163a6 tempest-VolumesActionsTest-911298328 tempest-VolumesActionsTest-911298328-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:54:58 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-6e27491c-cf16-49e1-89ca-8c9511a163a6 tempest-VolumesActionsTest-911298328 tempest-VolumesActionsTest-911298328-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:54:58 user devstack@n-api.service[61308]: INFO nova.api.openstack.wsgi [None req-6e27491c-cf16-49e1-89ca-8c9511a163a6 tempest-VolumesActionsTest-911298328 tempest-VolumesActionsTest-911298328-project-member] HTTP exception thrown: Instance 39775e82-0123-41cf-ad97-d3865a796828 could not be found. Apr 23 03:54:58 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi [None req-6e27491c-cf16-49e1-89ca-8c9511a163a6 tempest-VolumesActionsTest-911298328 tempest-VolumesActionsTest-911298328-project-member] Request method failure captured: Apr 23 03:54:58 user devstack@n-api.service[61308]: request: GET /compute/v2.1/servers/39775e82-0123-41cf-ad97-d3865a796828 HTTP/1.1 Apr 23 03:54:58 user devstack@n-api.service[61308]: Accept: application/json Apr 23 03:54:58 user devstack@n-api.service[61308]: Accept-Encoding: identity Apr 23 03:54:58 user devstack@n-api.service[61308]: Connection: close Apr 23 03:54:58 user devstack@n-api.service[61308]: Content-Length: 0 Apr 23 03:54:58 user devstack@n-api.service[61308]: Content-Type: application/json Apr 23 03:54:58 user devstack@n-api.service[61308]: Host: 10.0.0.210 Apr 23 03:54:58 user devstack@n-api.service[61308]: Openstack-System-Scope: None Apr 23 03:54:58 user devstack@n-api.service[61308]: User-Agent: python-urllib3/1.26.15 Apr 23 03:54:58 user devstack@n-api.service[61308]: X-Auth-Token: gAAAAABkRKtsecApghaUkuOjX4cBoWF3bZKjmjy0KrCto1ecXX1zyneief7Y6myD__UtN3uX8pI1uuBudSXnRo2w0CwVtofQbJlKLn0uomUBEKSXET_SzFGoX5mOns9ic1zHBCUscCim2b8AXkdIotwW2Wx4K-PPJAe83Ml2pIopOTdU26cdPvA Apr 23 03:54:58 user devstack@n-api.service[61308]: X-Domain-Id: None Apr 23 03:54:58 user devstack@n-api.service[61308]: X-Domain-Name: None Apr 23 03:54:58 user devstack@n-api.service[61308]: X-Identity-Status: Confirmed Apr 23 03:54:58 user devstack@n-api.service[61308]: X-Is-Admin-Project: True Apr 23 03:54:58 user devstack@n-api.service[61308]: X-Project-Domain-Id: default Apr 23 03:54:58 user devstack@n-api.service[61308]: X-Project-Domain-Name: Default Apr 23 03:54:58 user devstack@n-api.service[61308]: X-Project-Id: 037d3963711a4727a4def98cfff4da67 Apr 23 03:54:58 user devstack@n-api.service[61308]: X-Project-Name: tempest-VolumesActionsTest-911298328 Apr 23 03:54:58 user devstack@n-api.service[61308]: X-Role: reader,member Apr 23 03:54:58 user devstack@n-api.service[61308]: X-Roles: reader,member Apr 23 03:54:58 user devstack@n-api.service[61308]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/037d3963711a4727a4def98cfff4da67"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/037d3963711a4727a4def98cfff4da67"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/037d3963711a4727a4def98cfff4da67"}]}] Apr 23 03:54:58 user devstack@n-api.service[61308]: X-Tenant: tempest-VolumesActionsTest-911298328 Apr 23 03:54:58 user devstack@n-api.service[61308]: X-Tenant-Id: 037d3963711a4727a4def98cfff4da67 Apr 23 03:54:58 user devstack@n-api.service[61308]: X-Tenant-Name: tempest-VolumesActionsTest-911298328 Apr 23 03:54:58 user devstack@n-api.service[61308]: X-User: tempest-VolumesActionsTest-911298328-project-member Apr 23 03:54:58 user devstack@n-api.service[61308]: X-User-Domain-Id: default Apr 23 03:54:58 user devstack@n-api.service[61308]: X-User-Domain-Name: Default Apr 23 03:54:58 user devstack@n-api.service[61308]: X-User-Id: 405152a49bf14ad68f5c96f767c70b3a Apr 23 03:54:58 user devstack@n-api.service[61308]: X-User-Name: tempest-VolumesActionsTest-911298328-project-member Apr 23 03:54:58 user devstack@n-api.service[61308]: method: > Apr 23 03:54:58 user devstack@n-api.service[61308]: exception: Instance 39775e82-0123-41cf-ad97-d3865a796828 could not be found. Apr 23 03:54:58 user devstack@n-api.service[61308]: action_args: {'id': '39775e82-0123-41cf-ad97-d3865a796828'} Apr 23 03:54:58 user devstack@n-api.service[61308]: {{(pid=61308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 23 03:54:58 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 23 03:54:58 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 23 03:54:58 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 23 03:54:58 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 23 03:54:58 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 23 03:54:58 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 23 03:54:58 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 23 03:54:58 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 23 03:54:58 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 23 03:54:58 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 39775e82-0123-41cf-ad97-d3865a796828 could not be found. Apr 23 03:54:58 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi Apr 23 03:54:58 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 23 03:54:58 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi Apr 23 03:54:58 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 23 03:54:58 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 23 03:54:58 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 23 03:54:58 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 23 03:54:58 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 23 03:54:58 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 23 03:54:58 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 23 03:54:58 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 23 03:54:58 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 23 03:54:58 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 23 03:54:58 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 23 03:54:58 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 23 03:54:58 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 23 03:54:58 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 39775e82-0123-41cf-ad97-d3865a796828 could not be found. Apr 23 03:54:58 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi Apr 23 03:54:58 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 23 03:54:58 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi Apr 23 03:54:58 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 23 03:54:58 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 23 03:54:58 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 23 03:54:58 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 23 03:54:58 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 23 03:54:58 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 39775e82-0123-41cf-ad97-d3865a796828 could not be found. Apr 23 03:54:58 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi Apr 23 03:54:58 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi [None req-6e27491c-cf16-49e1-89ca-8c9511a163a6 tempest-VolumesActionsTest-911298328 tempest-VolumesActionsTest-911298328-project-member] Returning 404 to user: Instance 39775e82-0123-41cf-ad97-d3865a796828 could not be found. {{(pid=61308) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 23 03:54:58 user devstack@n-api.service[61308]: INFO nova.api.openstack.requestlog [None req-6e27491c-cf16-49e1-89ca-8c9511a163a6 tempest-VolumesActionsTest-911298328 tempest-VolumesActionsTest-911298328-project-member] 10.0.0.210 "GET /compute/v2.1/servers/39775e82-0123-41cf-ad97-d3865a796828" status: 404 len: 111 microversion: 2.1 time: 0.031432 Apr 23 03:54:58 user devstack@n-api.service[61308]: [pid: 61308|app: 0|req: 109/319] 10.0.0.210 () {62 vars in 1313 bytes} [Sun Apr 23 03:54:58 2023] GET /compute/v2.1/servers/39775e82-0123-41cf-ad97-d3865a796828 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 23 03:55:17 user devstack@n-api.service[61306]: DEBUG dbcounter [-] [61306] Writing DB stats nova_api:SELECT=6 {{(pid=61306) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:55:17 user devstack@n-api.service[61306]: DEBUG dbcounter [-] [61306] Writing DB stats nova_cell1:SELECT=19,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61306) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:55:17 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi [None req-5263524d-2251-4242-b133-6a2da954fdbb tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] Calling method '>' {{(pid=61306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 03:55:17 user devstack@n-api.service[61306]: DEBUG nova.compute.api [None req-5263524d-2251-4242-b133-6a2da954fdbb tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] [instance: 954f41b2-5c67-41a4-b38b-ebf3ad60cac7] Fetching instance by UUID {{(pid=61306) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 23 03:55:17 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-5263524d-2251-4242-b133-6a2da954fdbb tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:55:17 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-5263524d-2251-4242-b133-6a2da954fdbb tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:55:17 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-5263524d-2251-4242-b133-6a2da954fdbb tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:55:17 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-5263524d-2251-4242-b133-6a2da954fdbb tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:55:17 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-5263524d-2251-4242-b133-6a2da954fdbb tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:55:17 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-5263524d-2251-4242-b133-6a2da954fdbb tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:55:17 user devstack@n-api.service[61306]: DEBUG nova.compute.api [None req-5263524d-2251-4242-b133-6a2da954fdbb tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] [instance: 954f41b2-5c67-41a4-b38b-ebf3ad60cac7] Going to try to terminate instance {{(pid=61306) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 23 03:55:17 user devstack@n-api.service[61306]: INFO nova.api.openstack.requestlog [None req-5263524d-2251-4242-b133-6a2da954fdbb tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/954f41b2-5c67-41a4-b38b-ebf3ad60cac7" status: 204 len: 0 microversion: 2.1 time: 0.112521 Apr 23 03:55:17 user devstack@n-api.service[61306]: [pid: 61306|app: 0|req: 105/320] 10.0.0.210 () {62 vars in 1316 bytes} [Sun Apr 23 03:55:17 2023] DELETE /compute/v2.1/servers/954f41b2-5c67-41a4-b38b-ebf3ad60cac7 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 23 03:55:17 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi [None req-9b6eab31-12e5-469e-ae9c-14186d949c19 tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] Calling method '>' {{(pid=61307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 03:55:17 user devstack@n-api.service[61307]: DEBUG nova.compute.api [None req-9b6eab31-12e5-469e-ae9c-14186d949c19 tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] [instance: 954f41b2-5c67-41a4-b38b-ebf3ad60cac7] Fetching instance by UUID {{(pid=61307) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 23 03:55:17 user devstack@n-api.service[61307]: DEBUG dbcounter [-] [61307] Writing DB stats nova_cell1:SELECT=27,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61307) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:55:17 user devstack@n-api.service[61307]: DEBUG dbcounter [-] [61307] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=61307) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:55:17 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-9b6eab31-12e5-469e-ae9c-14186d949c19 tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:55:17 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-9b6eab31-12e5-469e-ae9c-14186d949c19 tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:55:17 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-9b6eab31-12e5-469e-ae9c-14186d949c19 tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:55:17 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-9b6eab31-12e5-469e-ae9c-14186d949c19 tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:55:17 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-9b6eab31-12e5-469e-ae9c-14186d949c19 tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:55:17 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-9b6eab31-12e5-469e-ae9c-14186d949c19 tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:55:17 user devstack@n-api.service[61307]: DEBUG nova.policy [None req-9b6eab31-12e5-469e-ae9c-14186d949c19 tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdc8fe94058c46c28d4b3f16dc1e77ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f44fe9ba07e4e2f925d1a8952356e04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61307) authorize /opt/stack/nova/nova/policy.py:203}} Apr 23 03:55:17 user devstack@n-api.service[61307]: INFO nova.api.openstack.requestlog [None req-9b6eab31-12e5-469e-ae9c-14186d949c19 tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] 10.0.0.210 "GET /compute/v2.1/servers/954f41b2-5c67-41a4-b38b-ebf3ad60cac7" status: 200 len: 1664 microversion: 2.1 time: 0.293987 Apr 23 03:55:17 user devstack@n-api.service[61307]: [pid: 61307|app: 0|req: 107/321] 10.0.0.210 () {62 vars in 1313 bytes} [Sun Apr 23 03:55:17 2023] GET /compute/v2.1/servers/954f41b2-5c67-41a4-b38b-ebf3ad60cac7 => generated 1664 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 23 03:55:17 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi [req-b1de1bfa-78e2-40de-a8a6-c222efec6a6a req-4ba51817-8276-4310-b4b7-7c4df86e927d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "954f41b2-5c67-41a4-b38b-ebf3ad60cac7", "name": "network-vif-unplugged", "status": "completed", "tag": "97d945a1-b86e-4a6d-af52-23084b8eb175"}]} {{(pid=61308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 03:55:17 user devstack@n-api.service[61308]: DEBUG dbcounter [-] [61308] Writing DB stats nova_api:SELECT=2 {{(pid=61308) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:55:17 user devstack@n-api.service[61308]: DEBUG dbcounter [-] [61308] Writing DB stats nova_cell1:SELECT=2 {{(pid=61308) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:55:17 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [req-b1de1bfa-78e2-40de-a8a6-c222efec6a6a req-4ba51817-8276-4310-b4b7-7c4df86e927d service nova] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:55:17 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [req-b1de1bfa-78e2-40de-a8a6-c222efec6a6a req-4ba51817-8276-4310-b4b7-7c4df86e927d service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:55:17 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [req-b1de1bfa-78e2-40de-a8a6-c222efec6a6a req-4ba51817-8276-4310-b4b7-7c4df86e927d service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:55:17 user devstack@n-api.service[61308]: INFO nova.api.openstack.compute.server_external_events [req-b1de1bfa-78e2-40de-a8a6-c222efec6a6a req-4ba51817-8276-4310-b4b7-7c4df86e927d service nova] Creating event network-vif-unplugged:97d945a1-b86e-4a6d-af52-23084b8eb175 for instance 954f41b2-5c67-41a4-b38b-ebf3ad60cac7 on user Apr 23 03:55:17 user devstack@n-api.service[61308]: INFO nova.api.openstack.requestlog [req-b1de1bfa-78e2-40de-a8a6-c222efec6a6a req-4ba51817-8276-4310-b4b7-7c4df86e927d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032218 Apr 23 03:55:17 user devstack@n-api.service[61308]: [pid: 61308|app: 0|req: 110/322] 10.0.0.210 () {68 vars in 1394 bytes} [Sun Apr 23 03:55:17 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 23 03:55:20 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi [req-b076f8a8-db6c-401a-9ff2-d25c30df96e6 req-8d47748a-fb1e-4112-9fc7-838eda4f1553 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "954f41b2-5c67-41a4-b38b-ebf3ad60cac7", "name": "network-vif-plugged", "status": "completed", "tag": "97d945a1-b86e-4a6d-af52-23084b8eb175"}, {"server_uuid": "954f41b2-5c67-41a4-b38b-ebf3ad60cac7", "name": "network-vif-deleted", "tag": "97d945a1-b86e-4a6d-af52-23084b8eb175"}]} {{(pid=61306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 03:55:20 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [req-b076f8a8-db6c-401a-9ff2-d25c30df96e6 req-8d47748a-fb1e-4112-9fc7-838eda4f1553 service nova] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:55:20 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [req-b076f8a8-db6c-401a-9ff2-d25c30df96e6 req-8d47748a-fb1e-4112-9fc7-838eda4f1553 service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:55:20 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [req-b076f8a8-db6c-401a-9ff2-d25c30df96e6 req-8d47748a-fb1e-4112-9fc7-838eda4f1553 service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:55:20 user devstack@n-api.service[61306]: INFO nova.api.openstack.compute.server_external_events [req-b076f8a8-db6c-401a-9ff2-d25c30df96e6 req-8d47748a-fb1e-4112-9fc7-838eda4f1553 service nova] Creating event network-vif-plugged:97d945a1-b86e-4a6d-af52-23084b8eb175 for instance 954f41b2-5c67-41a4-b38b-ebf3ad60cac7 on user Apr 23 03:55:20 user devstack@n-api.service[61306]: INFO nova.api.openstack.compute.server_external_events [req-b076f8a8-db6c-401a-9ff2-d25c30df96e6 req-8d47748a-fb1e-4112-9fc7-838eda4f1553 service nova] Creating event network-vif-deleted:97d945a1-b86e-4a6d-af52-23084b8eb175 for instance 954f41b2-5c67-41a4-b38b-ebf3ad60cac7 on user Apr 23 03:55:20 user devstack@n-api.service[61306]: INFO nova.api.openstack.requestlog [req-b076f8a8-db6c-401a-9ff2-d25c30df96e6 req-8d47748a-fb1e-4112-9fc7-838eda4f1553 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.031705 Apr 23 03:55:20 user devstack@n-api.service[61306]: [pid: 61306|app: 0|req: 106/323] 10.0.0.210 () {68 vars in 1394 bytes} [Sun Apr 23 03:55:20 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 23 03:55:31 user devstack@n-api.service[61307]: DEBUG dbcounter [-] [61307] Writing DB stats nova_api:SELECT=2 {{(pid=61307) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:55:31 user devstack@n-api.service[61307]: DEBUG dbcounter [-] [61307] Writing DB stats nova_cell1:SELECT=6 {{(pid=61307) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:55:31 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi [None req-e3385f5d-0e05-4a9a-b2e6-00c610225768 tempest-TestStampPattern-1064981600 tempest-TestStampPattern-1064981600-project-member] Action: 'create', calling method: .version_select at 0x7f21e10cd480>, body: {"keypair": {"name": "tempest-TestStampPattern-966196288", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD7k+0eOm7pK8X+pQq8e7fEEx1KuvuJWxdMAvBwHrnlCv/3pPMCfWmgSVPaXE936kFeYjIslx0hgDPmhHFNosrB/s1EsQf49jL2iuA7ElIGNe9545Ya233CDyy19FbJdPA=="}} {{(pid=61307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 03:55:31 user devstack@n-api.service[61307]: DEBUG nova.quota [None req-e3385f5d-0e05-4a9a-b2e6-00c610225768 tempest-TestStampPattern-1064981600 tempest-TestStampPattern-1064981600-project-member] Getting quotas for project ea208b32da1241b2987ae99a61abfa49. Resources: {'key_pairs'} {{(pid=61307) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 23 03:55:31 user devstack@n-api.service[61307]: DEBUG nova.quota [None req-e3385f5d-0e05-4a9a-b2e6-00c610225768 tempest-TestStampPattern-1064981600 tempest-TestStampPattern-1064981600-project-member] Getting quotas for user 6703a2f8d71145299b5cfd9c94621f3d and project ea208b32da1241b2987ae99a61abfa49. Resources: {'key_pairs'} {{(pid=61307) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 23 03:55:31 user devstack@n-api.service[61307]: INFO nova.api.openstack.requestlog [None req-e3385f5d-0e05-4a9a-b2e6-00c610225768 tempest-TestStampPattern-1064981600 tempest-TestStampPattern-1064981600-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 394 microversion: 2.1 time: 0.313887 Apr 23 03:55:31 user devstack@n-api.service[61307]: [pid: 61307|app: 0|req: 108/324] 10.0.0.210 () {64 vars in 1236 bytes} [Sun Apr 23 03:55:31 2023] POST /compute/v2.1/os-keypairs => generated 394 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 23 03:55:34 user devstack@n-api.service[61308]: DEBUG dbcounter [-] [61308] Writing DB stats nova_api:SELECT=2 {{(pid=61308) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:55:34 user devstack@n-api.service[61308]: DEBUG dbcounter [-] [61308] Writing DB stats nova_cell1:SELECT=2 {{(pid=61308) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:55:34 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi [None req-e184357c-8cf9-4c20-a047-b10366b8ea40 tempest-TestStampPattern-1064981600 tempest-TestStampPattern-1064981600-project-member] Calling method '.version_select at 0x7f21e113be20>' {{(pid=61308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 03:55:34 user devstack@n-api.service[61308]: INFO nova.api.openstack.requestlog [None req-e184357c-8cf9-4c20-a047-b10366b8ea40 tempest-TestStampPattern-1064981600 tempest-TestStampPattern-1064981600-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestStampPattern-966196288" status: 202 len: 0 microversion: 2.1 time: 0.025420 Apr 23 03:55:34 user devstack@n-api.service[61308]: [pid: 61308|app: 0|req: 111/325] 10.0.0.210 () {62 vars in 1322 bytes} [Sun Apr 23 03:55:34 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestStampPattern-966196288 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 23 03:55:34 user devstack@n-api.service[61306]: DEBUG dbcounter [-] [61306] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61306) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:55:34 user devstack@n-api.service[61306]: DEBUG dbcounter [-] [61306] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61306) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:55:34 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi [None req-de8d967a-7520-48cf-926d-d60646591e57 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Calling method '>' {{(pid=61306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 03:55:34 user devstack@n-api.service[61306]: DEBUG nova.compute.api [None req-de8d967a-7520-48cf-926d-d60646591e57 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] [instance: c21ec3a3-0761-4543-ad43-dca2913d159b] Fetching instance by UUID {{(pid=61306) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 23 03:55:34 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-de8d967a-7520-48cf-926d-d60646591e57 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:55:34 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-de8d967a-7520-48cf-926d-d60646591e57 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:55:34 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-de8d967a-7520-48cf-926d-d60646591e57 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:55:34 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-de8d967a-7520-48cf-926d-d60646591e57 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:55:34 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-de8d967a-7520-48cf-926d-d60646591e57 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:55:34 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-de8d967a-7520-48cf-926d-d60646591e57 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:55:34 user devstack@n-api.service[61306]: INFO nova.api.openstack.wsgi [None req-de8d967a-7520-48cf-926d-d60646591e57 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] HTTP exception thrown: Instance c21ec3a3-0761-4543-ad43-dca2913d159b could not be found. Apr 23 03:55:34 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi [None req-de8d967a-7520-48cf-926d-d60646591e57 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Request method failure captured: Apr 23 03:55:34 user devstack@n-api.service[61306]: request: GET /compute/v2.1/servers/c21ec3a3-0761-4543-ad43-dca2913d159b HTTP/1.1 Apr 23 03:55:34 user devstack@n-api.service[61306]: Accept: application/json Apr 23 03:55:34 user devstack@n-api.service[61306]: Accept-Encoding: identity Apr 23 03:55:34 user devstack@n-api.service[61306]: Connection: close Apr 23 03:55:34 user devstack@n-api.service[61306]: Content-Length: 0 Apr 23 03:55:34 user devstack@n-api.service[61306]: Content-Type: application/json Apr 23 03:55:34 user devstack@n-api.service[61306]: Host: 10.0.0.210 Apr 23 03:55:34 user devstack@n-api.service[61306]: Openstack-System-Scope: None Apr 23 03:55:34 user devstack@n-api.service[61306]: User-Agent: python-urllib3/1.26.15 Apr 23 03:55:34 user devstack@n-api.service[61306]: X-Auth-Token: gAAAAABkRKpATlQnMMf7AtMe3Mh47zSQG6r9ePVSL6VRK9keRxp6Gc7HMzsz_tP8tNowWY8eeXU0HpQXr0oDoCaKK212ZCUgOzicpa4lTfvIkKDveVvGHNmHGf_zIb8xjb2T8bafSts450cf0HsaSh4WH6WoE9_DYKPyo7TkDFQdEsMNjyWu92U Apr 23 03:55:34 user devstack@n-api.service[61306]: X-Domain-Id: None Apr 23 03:55:34 user devstack@n-api.service[61306]: X-Domain-Name: None Apr 23 03:55:34 user devstack@n-api.service[61306]: X-Identity-Status: Confirmed Apr 23 03:55:34 user devstack@n-api.service[61306]: X-Is-Admin-Project: True Apr 23 03:55:34 user devstack@n-api.service[61306]: X-Project-Domain-Id: default Apr 23 03:55:34 user devstack@n-api.service[61306]: X-Project-Domain-Name: Default Apr 23 03:55:34 user devstack@n-api.service[61306]: X-Project-Id: 24fff486a500421397ecb935828582cd Apr 23 03:55:34 user devstack@n-api.service[61306]: X-Project-Name: tempest-AttachVolumeNegativeTest-636753786 Apr 23 03:55:34 user devstack@n-api.service[61306]: X-Role: reader,member Apr 23 03:55:34 user devstack@n-api.service[61306]: X-Roles: reader,member Apr 23 03:55:34 user devstack@n-api.service[61306]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/24fff486a500421397ecb935828582cd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/24fff486a500421397ecb935828582cd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/24fff486a500421397ecb935828582cd"}]}] Apr 23 03:55:34 user devstack@n-api.service[61306]: X-Tenant: tempest-AttachVolumeNegativeTest-636753786 Apr 23 03:55:34 user devstack@n-api.service[61306]: X-Tenant-Id: 24fff486a500421397ecb935828582cd Apr 23 03:55:34 user devstack@n-api.service[61306]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-636753786 Apr 23 03:55:34 user devstack@n-api.service[61306]: X-User: tempest-AttachVolumeNegativeTest-636753786-project-member Apr 23 03:55:34 user devstack@n-api.service[61306]: X-User-Domain-Id: default Apr 23 03:55:34 user devstack@n-api.service[61306]: X-User-Domain-Name: Default Apr 23 03:55:34 user devstack@n-api.service[61306]: X-User-Id: 0a2c459cad014b07b2613e5e261d88aa Apr 23 03:55:34 user devstack@n-api.service[61306]: X-User-Name: tempest-AttachVolumeNegativeTest-636753786-project-member Apr 23 03:55:34 user devstack@n-api.service[61306]: method: > Apr 23 03:55:34 user devstack@n-api.service[61306]: exception: Instance c21ec3a3-0761-4543-ad43-dca2913d159b could not be found. Apr 23 03:55:34 user devstack@n-api.service[61306]: action_args: {'id': 'c21ec3a3-0761-4543-ad43-dca2913d159b'} Apr 23 03:55:34 user devstack@n-api.service[61306]: {{(pid=61306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 23 03:55:34 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 23 03:55:34 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 23 03:55:34 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 23 03:55:34 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 23 03:55:34 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 23 03:55:34 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 23 03:55:34 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 23 03:55:34 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 23 03:55:34 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 23 03:55:34 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c21ec3a3-0761-4543-ad43-dca2913d159b could not be found. Apr 23 03:55:34 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi Apr 23 03:55:34 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 23 03:55:34 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi Apr 23 03:55:34 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 23 03:55:34 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 23 03:55:34 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 23 03:55:34 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 23 03:55:34 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 23 03:55:34 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 23 03:55:34 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 23 03:55:34 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 23 03:55:34 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 23 03:55:34 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 23 03:55:34 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 23 03:55:34 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 23 03:55:34 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 23 03:55:34 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c21ec3a3-0761-4543-ad43-dca2913d159b could not be found. Apr 23 03:55:34 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi Apr 23 03:55:34 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 23 03:55:34 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi Apr 23 03:55:34 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 23 03:55:34 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 23 03:55:34 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 23 03:55:34 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 23 03:55:34 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 23 03:55:34 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c21ec3a3-0761-4543-ad43-dca2913d159b could not be found. Apr 23 03:55:34 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi Apr 23 03:55:34 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi [None req-de8d967a-7520-48cf-926d-d60646591e57 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Returning 404 to user: Instance c21ec3a3-0761-4543-ad43-dca2913d159b could not be found. {{(pid=61306) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 23 03:55:34 user devstack@n-api.service[61306]: INFO nova.api.openstack.requestlog [None req-de8d967a-7520-48cf-926d-d60646591e57 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c21ec3a3-0761-4543-ad43-dca2913d159b" status: 404 len: 111 microversion: 2.1 time: 0.035641 Apr 23 03:55:34 user devstack@n-api.service[61306]: [pid: 61306|app: 0|req: 107/326] 10.0.0.210 () {62 vars in 1313 bytes} [Sun Apr 23 03:55:34 2023] GET /compute/v2.1/servers/c21ec3a3-0761-4543-ad43-dca2913d159b => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 23 03:55:34 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi [None req-25d1db02-cc40-49d2-8b75-77033f98ea1e tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Calling method '.version_select at 0x7f21e10cd090>' {{(pid=61307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 03:55:34 user devstack@n-api.service[61307]: INFO nova.api.openstack.requestlog [None req-25d1db02-cc40-49d2-8b75-77033f98ea1e tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-325673571" status: 202 len: 0 microversion: 2.1 time: 0.021473 Apr 23 03:55:34 user devstack@n-api.service[61307]: [pid: 61307|app: 0|req: 109/327] 10.0.0.210 () {62 vars in 1295 bytes} [Sun Apr 23 03:55:34 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-325673571 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 23 03:55:35 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi [None req-efa4c956-c85c-4a93-b9c6-4e8adfefd250 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Calling method '>' {{(pid=61308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 03:55:35 user devstack@n-api.service[61308]: DEBUG nova.compute.api [None req-efa4c956-c85c-4a93-b9c6-4e8adfefd250 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] [instance: c21ec3a3-0761-4543-ad43-dca2913d159b] Fetching instance by UUID {{(pid=61308) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 23 03:55:35 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-efa4c956-c85c-4a93-b9c6-4e8adfefd250 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:55:35 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-efa4c956-c85c-4a93-b9c6-4e8adfefd250 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:55:35 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-efa4c956-c85c-4a93-b9c6-4e8adfefd250 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:55:35 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-efa4c956-c85c-4a93-b9c6-4e8adfefd250 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:55:35 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-efa4c956-c85c-4a93-b9c6-4e8adfefd250 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:55:35 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-efa4c956-c85c-4a93-b9c6-4e8adfefd250 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:55:35 user devstack@n-api.service[61308]: INFO nova.api.openstack.wsgi [None req-efa4c956-c85c-4a93-b9c6-4e8adfefd250 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] HTTP exception thrown: Instance c21ec3a3-0761-4543-ad43-dca2913d159b could not be found. Apr 23 03:55:35 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi [None req-efa4c956-c85c-4a93-b9c6-4e8adfefd250 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Request method failure captured: Apr 23 03:55:35 user devstack@n-api.service[61308]: request: DELETE /compute/v2.1/servers/c21ec3a3-0761-4543-ad43-dca2913d159b HTTP/1.1 Apr 23 03:55:35 user devstack@n-api.service[61308]: Accept: application/json Apr 23 03:55:35 user devstack@n-api.service[61308]: Accept-Encoding: identity Apr 23 03:55:35 user devstack@n-api.service[61308]: Connection: close Apr 23 03:55:35 user devstack@n-api.service[61308]: Content-Length: 0 Apr 23 03:55:35 user devstack@n-api.service[61308]: Content-Type: application/json Apr 23 03:55:35 user devstack@n-api.service[61308]: Host: 10.0.0.210 Apr 23 03:55:35 user devstack@n-api.service[61308]: Openstack-System-Scope: None Apr 23 03:55:35 user devstack@n-api.service[61308]: User-Agent: python-urllib3/1.26.15 Apr 23 03:55:35 user devstack@n-api.service[61308]: X-Auth-Token: gAAAAABkRKpATlQnMMf7AtMe3Mh47zSQG6r9ePVSL6VRK9keRxp6Gc7HMzsz_tP8tNowWY8eeXU0HpQXr0oDoCaKK212ZCUgOzicpa4lTfvIkKDveVvGHNmHGf_zIb8xjb2T8bafSts450cf0HsaSh4WH6WoE9_DYKPyo7TkDFQdEsMNjyWu92U Apr 23 03:55:35 user devstack@n-api.service[61308]: X-Domain-Id: None Apr 23 03:55:35 user devstack@n-api.service[61308]: X-Domain-Name: None Apr 23 03:55:35 user devstack@n-api.service[61308]: X-Identity-Status: Confirmed Apr 23 03:55:35 user devstack@n-api.service[61308]: X-Is-Admin-Project: True Apr 23 03:55:35 user devstack@n-api.service[61308]: X-Project-Domain-Id: default Apr 23 03:55:35 user devstack@n-api.service[61308]: X-Project-Domain-Name: Default Apr 23 03:55:35 user devstack@n-api.service[61308]: X-Project-Id: 24fff486a500421397ecb935828582cd Apr 23 03:55:35 user devstack@n-api.service[61308]: X-Project-Name: tempest-AttachVolumeNegativeTest-636753786 Apr 23 03:55:35 user devstack@n-api.service[61308]: X-Role: reader,member Apr 23 03:55:35 user devstack@n-api.service[61308]: X-Roles: reader,member Apr 23 03:55:35 user devstack@n-api.service[61308]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/24fff486a500421397ecb935828582cd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/24fff486a500421397ecb935828582cd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/24fff486a500421397ecb935828582cd"}]}] Apr 23 03:55:35 user devstack@n-api.service[61308]: X-Tenant: tempest-AttachVolumeNegativeTest-636753786 Apr 23 03:55:35 user devstack@n-api.service[61308]: X-Tenant-Id: 24fff486a500421397ecb935828582cd Apr 23 03:55:35 user devstack@n-api.service[61308]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-636753786 Apr 23 03:55:35 user devstack@n-api.service[61308]: X-User: tempest-AttachVolumeNegativeTest-636753786-project-member Apr 23 03:55:35 user devstack@n-api.service[61308]: X-User-Domain-Id: default Apr 23 03:55:35 user devstack@n-api.service[61308]: X-User-Domain-Name: Default Apr 23 03:55:35 user devstack@n-api.service[61308]: X-User-Id: 0a2c459cad014b07b2613e5e261d88aa Apr 23 03:55:35 user devstack@n-api.service[61308]: X-User-Name: tempest-AttachVolumeNegativeTest-636753786-project-member Apr 23 03:55:35 user devstack@n-api.service[61308]: method: > Apr 23 03:55:35 user devstack@n-api.service[61308]: exception: Instance c21ec3a3-0761-4543-ad43-dca2913d159b could not be found. Apr 23 03:55:35 user devstack@n-api.service[61308]: action_args: {'id': 'c21ec3a3-0761-4543-ad43-dca2913d159b'} Apr 23 03:55:35 user devstack@n-api.service[61308]: {{(pid=61308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 23 03:55:35 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 23 03:55:35 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 23 03:55:35 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 23 03:55:35 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 23 03:55:35 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 23 03:55:35 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 23 03:55:35 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 23 03:55:35 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 23 03:55:35 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 23 03:55:35 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c21ec3a3-0761-4543-ad43-dca2913d159b could not be found. Apr 23 03:55:35 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi Apr 23 03:55:35 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 23 03:55:35 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi Apr 23 03:55:35 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 23 03:55:35 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 23 03:55:35 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 23 03:55:35 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 23 03:55:35 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 23 03:55:35 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 23 03:55:35 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 23 03:55:35 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 23 03:55:35 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 23 03:55:35 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 23 03:55:35 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 23 03:55:35 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 23 03:55:35 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 23 03:55:35 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 23 03:55:35 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 23 03:55:35 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c21ec3a3-0761-4543-ad43-dca2913d159b could not be found. Apr 23 03:55:35 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi Apr 23 03:55:35 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 23 03:55:35 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi Apr 23 03:55:35 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 23 03:55:35 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 23 03:55:35 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 23 03:55:35 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 23 03:55:35 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 23 03:55:35 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c21ec3a3-0761-4543-ad43-dca2913d159b could not be found. Apr 23 03:55:35 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi Apr 23 03:55:35 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi [None req-efa4c956-c85c-4a93-b9c6-4e8adfefd250 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Returning 404 to user: Instance c21ec3a3-0761-4543-ad43-dca2913d159b could not be found. {{(pid=61308) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 23 03:55:35 user devstack@n-api.service[61308]: INFO nova.api.openstack.requestlog [None req-efa4c956-c85c-4a93-b9c6-4e8adfefd250 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/c21ec3a3-0761-4543-ad43-dca2913d159b" status: 404 len: 111 microversion: 2.1 time: 0.028620 Apr 23 03:55:35 user devstack@n-api.service[61308]: [pid: 61308|app: 0|req: 112/328] 10.0.0.210 () {62 vars in 1316 bytes} [Sun Apr 23 03:55:35 2023] DELETE /compute/v2.1/servers/c21ec3a3-0761-4543-ad43-dca2913d159b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 23 03:55:35 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi [None req-85cab45b-b487-47b8-bec8-4ae6ca6c032d tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Calling method '>' {{(pid=61306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 03:55:35 user devstack@n-api.service[61306]: DEBUG nova.compute.api [None req-85cab45b-b487-47b8-bec8-4ae6ca6c032d tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] [instance: c21ec3a3-0761-4543-ad43-dca2913d159b] Fetching instance by UUID {{(pid=61306) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 23 03:55:35 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-85cab45b-b487-47b8-bec8-4ae6ca6c032d tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:55:35 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-85cab45b-b487-47b8-bec8-4ae6ca6c032d tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:55:35 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-85cab45b-b487-47b8-bec8-4ae6ca6c032d tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:55:35 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-85cab45b-b487-47b8-bec8-4ae6ca6c032d tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:55:35 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-85cab45b-b487-47b8-bec8-4ae6ca6c032d tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:55:35 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-85cab45b-b487-47b8-bec8-4ae6ca6c032d tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:55:35 user devstack@n-api.service[61306]: INFO nova.api.openstack.wsgi [None req-85cab45b-b487-47b8-bec8-4ae6ca6c032d tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] HTTP exception thrown: Instance c21ec3a3-0761-4543-ad43-dca2913d159b could not be found. Apr 23 03:55:35 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi [None req-85cab45b-b487-47b8-bec8-4ae6ca6c032d tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Request method failure captured: Apr 23 03:55:35 user devstack@n-api.service[61306]: request: GET /compute/v2.1/servers/c21ec3a3-0761-4543-ad43-dca2913d159b HTTP/1.1 Apr 23 03:55:35 user devstack@n-api.service[61306]: Accept: application/json Apr 23 03:55:35 user devstack@n-api.service[61306]: Accept-Encoding: identity Apr 23 03:55:35 user devstack@n-api.service[61306]: Connection: close Apr 23 03:55:35 user devstack@n-api.service[61306]: Content-Length: 0 Apr 23 03:55:35 user devstack@n-api.service[61306]: Content-Type: application/json Apr 23 03:55:35 user devstack@n-api.service[61306]: Host: 10.0.0.210 Apr 23 03:55:35 user devstack@n-api.service[61306]: Openstack-System-Scope: None Apr 23 03:55:35 user devstack@n-api.service[61306]: User-Agent: python-urllib3/1.26.15 Apr 23 03:55:35 user devstack@n-api.service[61306]: X-Auth-Token: gAAAAABkRKpATlQnMMf7AtMe3Mh47zSQG6r9ePVSL6VRK9keRxp6Gc7HMzsz_tP8tNowWY8eeXU0HpQXr0oDoCaKK212ZCUgOzicpa4lTfvIkKDveVvGHNmHGf_zIb8xjb2T8bafSts450cf0HsaSh4WH6WoE9_DYKPyo7TkDFQdEsMNjyWu92U Apr 23 03:55:35 user devstack@n-api.service[61306]: X-Domain-Id: None Apr 23 03:55:35 user devstack@n-api.service[61306]: X-Domain-Name: None Apr 23 03:55:35 user devstack@n-api.service[61306]: X-Identity-Status: Confirmed Apr 23 03:55:35 user devstack@n-api.service[61306]: X-Is-Admin-Project: True Apr 23 03:55:35 user devstack@n-api.service[61306]: X-Project-Domain-Id: default Apr 23 03:55:35 user devstack@n-api.service[61306]: X-Project-Domain-Name: Default Apr 23 03:55:35 user devstack@n-api.service[61306]: X-Project-Id: 24fff486a500421397ecb935828582cd Apr 23 03:55:35 user devstack@n-api.service[61306]: X-Project-Name: tempest-AttachVolumeNegativeTest-636753786 Apr 23 03:55:35 user devstack@n-api.service[61306]: X-Role: reader,member Apr 23 03:55:35 user devstack@n-api.service[61306]: X-Roles: reader,member Apr 23 03:55:35 user devstack@n-api.service[61306]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/24fff486a500421397ecb935828582cd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/24fff486a500421397ecb935828582cd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/24fff486a500421397ecb935828582cd"}]}] Apr 23 03:55:35 user devstack@n-api.service[61306]: X-Tenant: tempest-AttachVolumeNegativeTest-636753786 Apr 23 03:55:35 user devstack@n-api.service[61306]: X-Tenant-Id: 24fff486a500421397ecb935828582cd Apr 23 03:55:35 user devstack@n-api.service[61306]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-636753786 Apr 23 03:55:35 user devstack@n-api.service[61306]: X-User: tempest-AttachVolumeNegativeTest-636753786-project-member Apr 23 03:55:35 user devstack@n-api.service[61306]: X-User-Domain-Id: default Apr 23 03:55:35 user devstack@n-api.service[61306]: X-User-Domain-Name: Default Apr 23 03:55:35 user devstack@n-api.service[61306]: X-User-Id: 0a2c459cad014b07b2613e5e261d88aa Apr 23 03:55:35 user devstack@n-api.service[61306]: X-User-Name: tempest-AttachVolumeNegativeTest-636753786-project-member Apr 23 03:55:35 user devstack@n-api.service[61306]: method: > Apr 23 03:55:35 user devstack@n-api.service[61306]: exception: Instance c21ec3a3-0761-4543-ad43-dca2913d159b could not be found. Apr 23 03:55:35 user devstack@n-api.service[61306]: action_args: {'id': 'c21ec3a3-0761-4543-ad43-dca2913d159b'} Apr 23 03:55:35 user devstack@n-api.service[61306]: {{(pid=61306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 23 03:55:35 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 23 03:55:35 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 23 03:55:35 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 23 03:55:35 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 23 03:55:35 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 23 03:55:35 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 23 03:55:35 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 23 03:55:35 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 23 03:55:35 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 23 03:55:35 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c21ec3a3-0761-4543-ad43-dca2913d159b could not be found. Apr 23 03:55:35 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi Apr 23 03:55:35 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 23 03:55:35 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi Apr 23 03:55:35 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 23 03:55:35 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 23 03:55:35 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 23 03:55:35 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 23 03:55:35 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 23 03:55:35 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 23 03:55:35 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 23 03:55:35 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 23 03:55:35 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 23 03:55:35 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 23 03:55:35 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 23 03:55:35 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 23 03:55:35 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 23 03:55:35 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c21ec3a3-0761-4543-ad43-dca2913d159b could not be found. Apr 23 03:55:35 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi Apr 23 03:55:35 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 23 03:55:35 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi Apr 23 03:55:35 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 23 03:55:35 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 23 03:55:35 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 23 03:55:35 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 23 03:55:35 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 23 03:55:35 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c21ec3a3-0761-4543-ad43-dca2913d159b could not be found. Apr 23 03:55:35 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi Apr 23 03:55:35 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi [None req-85cab45b-b487-47b8-bec8-4ae6ca6c032d tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Returning 404 to user: Instance c21ec3a3-0761-4543-ad43-dca2913d159b could not be found. {{(pid=61306) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 23 03:55:35 user devstack@n-api.service[61306]: INFO nova.api.openstack.requestlog [None req-85cab45b-b487-47b8-bec8-4ae6ca6c032d tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c21ec3a3-0761-4543-ad43-dca2913d159b" status: 404 len: 111 microversion: 2.1 time: 0.029314 Apr 23 03:55:35 user devstack@n-api.service[61306]: [pid: 61306|app: 0|req: 108/329] 10.0.0.210 () {62 vars in 1313 bytes} [Sun Apr 23 03:55:35 2023] GET /compute/v2.1/servers/c21ec3a3-0761-4543-ad43-dca2913d159b => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 23 03:55:35 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi [None req-823430a0-a558-4dd9-9dc4-2d2094731297 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Calling method '>' {{(pid=61307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 03:55:35 user devstack@n-api.service[61307]: DEBUG nova.compute.api [None req-823430a0-a558-4dd9-9dc4-2d2094731297 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] [instance: 7c1f1f24-62f5-4e51-8c74-b5b89b6585a4] Fetching instance by UUID {{(pid=61307) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 23 03:55:35 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-823430a0-a558-4dd9-9dc4-2d2094731297 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:55:35 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-823430a0-a558-4dd9-9dc4-2d2094731297 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:55:35 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-823430a0-a558-4dd9-9dc4-2d2094731297 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:55:35 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-823430a0-a558-4dd9-9dc4-2d2094731297 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:55:35 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-823430a0-a558-4dd9-9dc4-2d2094731297 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:55:35 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-823430a0-a558-4dd9-9dc4-2d2094731297 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:55:35 user devstack@n-api.service[61307]: INFO nova.api.openstack.wsgi [None req-823430a0-a558-4dd9-9dc4-2d2094731297 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] HTTP exception thrown: Instance 7c1f1f24-62f5-4e51-8c74-b5b89b6585a4 could not be found. Apr 23 03:55:35 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi [None req-823430a0-a558-4dd9-9dc4-2d2094731297 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Request method failure captured: Apr 23 03:55:35 user devstack@n-api.service[61307]: request: DELETE /compute/v2.1/servers/7c1f1f24-62f5-4e51-8c74-b5b89b6585a4 HTTP/1.1 Apr 23 03:55:35 user devstack@n-api.service[61307]: Accept: application/json Apr 23 03:55:35 user devstack@n-api.service[61307]: Accept-Encoding: identity Apr 23 03:55:35 user devstack@n-api.service[61307]: Connection: close Apr 23 03:55:35 user devstack@n-api.service[61307]: Content-Length: 0 Apr 23 03:55:35 user devstack@n-api.service[61307]: Content-Type: application/json Apr 23 03:55:35 user devstack@n-api.service[61307]: Host: 10.0.0.210 Apr 23 03:55:35 user devstack@n-api.service[61307]: Openstack-System-Scope: None Apr 23 03:55:35 user devstack@n-api.service[61307]: User-Agent: python-urllib3/1.26.15 Apr 23 03:55:35 user devstack@n-api.service[61307]: X-Auth-Token: gAAAAABkRKpATlQnMMf7AtMe3Mh47zSQG6r9ePVSL6VRK9keRxp6Gc7HMzsz_tP8tNowWY8eeXU0HpQXr0oDoCaKK212ZCUgOzicpa4lTfvIkKDveVvGHNmHGf_zIb8xjb2T8bafSts450cf0HsaSh4WH6WoE9_DYKPyo7TkDFQdEsMNjyWu92U Apr 23 03:55:35 user devstack@n-api.service[61307]: X-Domain-Id: None Apr 23 03:55:35 user devstack@n-api.service[61307]: X-Domain-Name: None Apr 23 03:55:35 user devstack@n-api.service[61307]: X-Identity-Status: Confirmed Apr 23 03:55:35 user devstack@n-api.service[61307]: X-Is-Admin-Project: True Apr 23 03:55:35 user devstack@n-api.service[61307]: X-Project-Domain-Id: default Apr 23 03:55:35 user devstack@n-api.service[61307]: X-Project-Domain-Name: Default Apr 23 03:55:35 user devstack@n-api.service[61307]: X-Project-Id: 24fff486a500421397ecb935828582cd Apr 23 03:55:35 user devstack@n-api.service[61307]: X-Project-Name: tempest-AttachVolumeNegativeTest-636753786 Apr 23 03:55:35 user devstack@n-api.service[61307]: X-Role: reader,member Apr 23 03:55:35 user devstack@n-api.service[61307]: X-Roles: reader,member Apr 23 03:55:35 user devstack@n-api.service[61307]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/24fff486a500421397ecb935828582cd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/24fff486a500421397ecb935828582cd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/24fff486a500421397ecb935828582cd"}]}] Apr 23 03:55:35 user devstack@n-api.service[61307]: X-Tenant: tempest-AttachVolumeNegativeTest-636753786 Apr 23 03:55:35 user devstack@n-api.service[61307]: X-Tenant-Id: 24fff486a500421397ecb935828582cd Apr 23 03:55:35 user devstack@n-api.service[61307]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-636753786 Apr 23 03:55:35 user devstack@n-api.service[61307]: X-User: tempest-AttachVolumeNegativeTest-636753786-project-member Apr 23 03:55:35 user devstack@n-api.service[61307]: X-User-Domain-Id: default Apr 23 03:55:35 user devstack@n-api.service[61307]: X-User-Domain-Name: Default Apr 23 03:55:35 user devstack@n-api.service[61307]: X-User-Id: 0a2c459cad014b07b2613e5e261d88aa Apr 23 03:55:35 user devstack@n-api.service[61307]: X-User-Name: tempest-AttachVolumeNegativeTest-636753786-project-member Apr 23 03:55:35 user devstack@n-api.service[61307]: method: > Apr 23 03:55:35 user devstack@n-api.service[61307]: exception: Instance 7c1f1f24-62f5-4e51-8c74-b5b89b6585a4 could not be found. Apr 23 03:55:35 user devstack@n-api.service[61307]: action_args: {'id': '7c1f1f24-62f5-4e51-8c74-b5b89b6585a4'} Apr 23 03:55:35 user devstack@n-api.service[61307]: {{(pid=61307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 23 03:55:35 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 23 03:55:35 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 23 03:55:35 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 23 03:55:35 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 23 03:55:35 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 23 03:55:35 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 23 03:55:35 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 23 03:55:35 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 23 03:55:35 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 23 03:55:35 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c1f1f24-62f5-4e51-8c74-b5b89b6585a4 could not be found. Apr 23 03:55:35 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi Apr 23 03:55:35 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 23 03:55:35 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi Apr 23 03:55:35 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 23 03:55:35 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 23 03:55:35 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 23 03:55:35 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 23 03:55:35 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 23 03:55:35 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 23 03:55:35 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 23 03:55:35 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 23 03:55:35 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 23 03:55:35 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 23 03:55:35 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 23 03:55:35 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 23 03:55:35 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 23 03:55:35 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 23 03:55:35 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 23 03:55:35 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c1f1f24-62f5-4e51-8c74-b5b89b6585a4 could not be found. Apr 23 03:55:35 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi Apr 23 03:55:35 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 23 03:55:35 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi Apr 23 03:55:35 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 23 03:55:35 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 23 03:55:35 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 23 03:55:35 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 23 03:55:35 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 23 03:55:35 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c1f1f24-62f5-4e51-8c74-b5b89b6585a4 could not be found. Apr 23 03:55:35 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi Apr 23 03:55:35 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi [None req-823430a0-a558-4dd9-9dc4-2d2094731297 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Returning 404 to user: Instance 7c1f1f24-62f5-4e51-8c74-b5b89b6585a4 could not be found. {{(pid=61307) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 23 03:55:35 user devstack@n-api.service[61307]: INFO nova.api.openstack.requestlog [None req-823430a0-a558-4dd9-9dc4-2d2094731297 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/7c1f1f24-62f5-4e51-8c74-b5b89b6585a4" status: 404 len: 111 microversion: 2.1 time: 0.026798 Apr 23 03:55:35 user devstack@n-api.service[61307]: [pid: 61307|app: 0|req: 110/330] 10.0.0.210 () {62 vars in 1316 bytes} [Sun Apr 23 03:55:35 2023] DELETE /compute/v2.1/servers/7c1f1f24-62f5-4e51-8c74-b5b89b6585a4 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 23 03:55:35 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi [None req-f2b0de6c-a214-42af-881e-e1dbfd100dcd tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Calling method '>' {{(pid=61308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 03:55:35 user devstack@n-api.service[61308]: DEBUG nova.compute.api [None req-f2b0de6c-a214-42af-881e-e1dbfd100dcd tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] [instance: 7c1f1f24-62f5-4e51-8c74-b5b89b6585a4] Fetching instance by UUID {{(pid=61308) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 23 03:55:35 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-f2b0de6c-a214-42af-881e-e1dbfd100dcd tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:55:35 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-f2b0de6c-a214-42af-881e-e1dbfd100dcd tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:55:35 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-f2b0de6c-a214-42af-881e-e1dbfd100dcd tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:55:35 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-f2b0de6c-a214-42af-881e-e1dbfd100dcd tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:55:35 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-f2b0de6c-a214-42af-881e-e1dbfd100dcd tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:55:35 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-f2b0de6c-a214-42af-881e-e1dbfd100dcd tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:55:35 user devstack@n-api.service[61308]: INFO nova.api.openstack.wsgi [None req-f2b0de6c-a214-42af-881e-e1dbfd100dcd tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] HTTP exception thrown: Instance 7c1f1f24-62f5-4e51-8c74-b5b89b6585a4 could not be found. Apr 23 03:55:35 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi [None req-f2b0de6c-a214-42af-881e-e1dbfd100dcd tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Request method failure captured: Apr 23 03:55:35 user devstack@n-api.service[61308]: request: GET /compute/v2.1/servers/7c1f1f24-62f5-4e51-8c74-b5b89b6585a4 HTTP/1.1 Apr 23 03:55:35 user devstack@n-api.service[61308]: Accept: application/json Apr 23 03:55:35 user devstack@n-api.service[61308]: Accept-Encoding: identity Apr 23 03:55:35 user devstack@n-api.service[61308]: Connection: close Apr 23 03:55:35 user devstack@n-api.service[61308]: Content-Length: 0 Apr 23 03:55:35 user devstack@n-api.service[61308]: Content-Type: application/json Apr 23 03:55:35 user devstack@n-api.service[61308]: Host: 10.0.0.210 Apr 23 03:55:35 user devstack@n-api.service[61308]: Openstack-System-Scope: None Apr 23 03:55:35 user devstack@n-api.service[61308]: User-Agent: python-urllib3/1.26.15 Apr 23 03:55:35 user devstack@n-api.service[61308]: X-Auth-Token: gAAAAABkRKpATlQnMMf7AtMe3Mh47zSQG6r9ePVSL6VRK9keRxp6Gc7HMzsz_tP8tNowWY8eeXU0HpQXr0oDoCaKK212ZCUgOzicpa4lTfvIkKDveVvGHNmHGf_zIb8xjb2T8bafSts450cf0HsaSh4WH6WoE9_DYKPyo7TkDFQdEsMNjyWu92U Apr 23 03:55:35 user devstack@n-api.service[61308]: X-Domain-Id: None Apr 23 03:55:35 user devstack@n-api.service[61308]: X-Domain-Name: None Apr 23 03:55:35 user devstack@n-api.service[61308]: X-Identity-Status: Confirmed Apr 23 03:55:35 user devstack@n-api.service[61308]: X-Is-Admin-Project: True Apr 23 03:55:35 user devstack@n-api.service[61308]: X-Project-Domain-Id: default Apr 23 03:55:35 user devstack@n-api.service[61308]: X-Project-Domain-Name: Default Apr 23 03:55:35 user devstack@n-api.service[61308]: X-Project-Id: 24fff486a500421397ecb935828582cd Apr 23 03:55:35 user devstack@n-api.service[61308]: X-Project-Name: tempest-AttachVolumeNegativeTest-636753786 Apr 23 03:55:35 user devstack@n-api.service[61308]: X-Role: reader,member Apr 23 03:55:35 user devstack@n-api.service[61308]: X-Roles: reader,member Apr 23 03:55:35 user devstack@n-api.service[61308]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/24fff486a500421397ecb935828582cd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/24fff486a500421397ecb935828582cd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/24fff486a500421397ecb935828582cd"}]}] Apr 23 03:55:35 user devstack@n-api.service[61308]: X-Tenant: tempest-AttachVolumeNegativeTest-636753786 Apr 23 03:55:35 user devstack@n-api.service[61308]: X-Tenant-Id: 24fff486a500421397ecb935828582cd Apr 23 03:55:35 user devstack@n-api.service[61308]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-636753786 Apr 23 03:55:35 user devstack@n-api.service[61308]: X-User: tempest-AttachVolumeNegativeTest-636753786-project-member Apr 23 03:55:35 user devstack@n-api.service[61308]: X-User-Domain-Id: default Apr 23 03:55:35 user devstack@n-api.service[61308]: X-User-Domain-Name: Default Apr 23 03:55:35 user devstack@n-api.service[61308]: X-User-Id: 0a2c459cad014b07b2613e5e261d88aa Apr 23 03:55:35 user devstack@n-api.service[61308]: X-User-Name: tempest-AttachVolumeNegativeTest-636753786-project-member Apr 23 03:55:35 user devstack@n-api.service[61308]: method: > Apr 23 03:55:35 user devstack@n-api.service[61308]: exception: Instance 7c1f1f24-62f5-4e51-8c74-b5b89b6585a4 could not be found. Apr 23 03:55:35 user devstack@n-api.service[61308]: action_args: {'id': '7c1f1f24-62f5-4e51-8c74-b5b89b6585a4'} Apr 23 03:55:35 user devstack@n-api.service[61308]: {{(pid=61308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 23 03:55:35 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 23 03:55:35 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 23 03:55:35 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 23 03:55:35 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 23 03:55:35 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 23 03:55:35 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 23 03:55:35 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 23 03:55:35 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 23 03:55:35 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 23 03:55:35 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c1f1f24-62f5-4e51-8c74-b5b89b6585a4 could not be found. Apr 23 03:55:35 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi Apr 23 03:55:35 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 23 03:55:35 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi Apr 23 03:55:35 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 23 03:55:35 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 23 03:55:35 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 23 03:55:35 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 23 03:55:35 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 23 03:55:35 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 23 03:55:35 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 23 03:55:35 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 23 03:55:35 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 23 03:55:35 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 23 03:55:35 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 23 03:55:35 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 23 03:55:35 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 23 03:55:35 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c1f1f24-62f5-4e51-8c74-b5b89b6585a4 could not be found. Apr 23 03:55:35 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi Apr 23 03:55:35 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 23 03:55:35 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi Apr 23 03:55:35 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 23 03:55:35 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 23 03:55:35 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 23 03:55:35 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 23 03:55:35 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 23 03:55:35 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c1f1f24-62f5-4e51-8c74-b5b89b6585a4 could not be found. Apr 23 03:55:35 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi Apr 23 03:55:35 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi [None req-f2b0de6c-a214-42af-881e-e1dbfd100dcd tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Returning 404 to user: Instance 7c1f1f24-62f5-4e51-8c74-b5b89b6585a4 could not be found. {{(pid=61308) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 23 03:55:35 user devstack@n-api.service[61308]: INFO nova.api.openstack.requestlog [None req-f2b0de6c-a214-42af-881e-e1dbfd100dcd tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7c1f1f24-62f5-4e51-8c74-b5b89b6585a4" status: 404 len: 111 microversion: 2.1 time: 0.028641 Apr 23 03:55:35 user devstack@n-api.service[61308]: [pid: 61308|app: 0|req: 113/331] 10.0.0.210 () {62 vars in 1313 bytes} [Sun Apr 23 03:55:35 2023] GET /compute/v2.1/servers/7c1f1f24-62f5-4e51-8c74-b5b89b6585a4 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 23 03:55:35 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi [None req-0a742955-aa60-4ffd-9446-e7c440579008 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Calling method '>' {{(pid=61306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 03:55:35 user devstack@n-api.service[61306]: DEBUG nova.compute.api [None req-0a742955-aa60-4ffd-9446-e7c440579008 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] [instance: 3ec36a95-88ce-4ed1-9726-7e6d98674dec] Fetching instance by UUID {{(pid=61306) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 23 03:55:35 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-0a742955-aa60-4ffd-9446-e7c440579008 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:55:35 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-0a742955-aa60-4ffd-9446-e7c440579008 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:55:35 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-0a742955-aa60-4ffd-9446-e7c440579008 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:55:35 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-0a742955-aa60-4ffd-9446-e7c440579008 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:55:35 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-0a742955-aa60-4ffd-9446-e7c440579008 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:55:35 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-0a742955-aa60-4ffd-9446-e7c440579008 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:55:35 user devstack@n-api.service[61306]: INFO nova.api.openstack.wsgi [None req-0a742955-aa60-4ffd-9446-e7c440579008 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] HTTP exception thrown: Instance 3ec36a95-88ce-4ed1-9726-7e6d98674dec could not be found. Apr 23 03:55:35 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi [None req-0a742955-aa60-4ffd-9446-e7c440579008 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Request method failure captured: Apr 23 03:55:35 user devstack@n-api.service[61306]: request: DELETE /compute/v2.1/servers/3ec36a95-88ce-4ed1-9726-7e6d98674dec HTTP/1.1 Apr 23 03:55:35 user devstack@n-api.service[61306]: Accept: application/json Apr 23 03:55:35 user devstack@n-api.service[61306]: Accept-Encoding: identity Apr 23 03:55:35 user devstack@n-api.service[61306]: Connection: close Apr 23 03:55:35 user devstack@n-api.service[61306]: Content-Length: 0 Apr 23 03:55:35 user devstack@n-api.service[61306]: Content-Type: application/json Apr 23 03:55:35 user devstack@n-api.service[61306]: Host: 10.0.0.210 Apr 23 03:55:35 user devstack@n-api.service[61306]: Openstack-System-Scope: None Apr 23 03:55:35 user devstack@n-api.service[61306]: User-Agent: python-urllib3/1.26.15 Apr 23 03:55:35 user devstack@n-api.service[61306]: X-Auth-Token: gAAAAABkRKpATlQnMMf7AtMe3Mh47zSQG6r9ePVSL6VRK9keRxp6Gc7HMzsz_tP8tNowWY8eeXU0HpQXr0oDoCaKK212ZCUgOzicpa4lTfvIkKDveVvGHNmHGf_zIb8xjb2T8bafSts450cf0HsaSh4WH6WoE9_DYKPyo7TkDFQdEsMNjyWu92U Apr 23 03:55:35 user devstack@n-api.service[61306]: X-Domain-Id: None Apr 23 03:55:35 user devstack@n-api.service[61306]: X-Domain-Name: None Apr 23 03:55:35 user devstack@n-api.service[61306]: X-Identity-Status: Confirmed Apr 23 03:55:35 user devstack@n-api.service[61306]: X-Is-Admin-Project: True Apr 23 03:55:35 user devstack@n-api.service[61306]: X-Project-Domain-Id: default Apr 23 03:55:35 user devstack@n-api.service[61306]: X-Project-Domain-Name: Default Apr 23 03:55:35 user devstack@n-api.service[61306]: X-Project-Id: 24fff486a500421397ecb935828582cd Apr 23 03:55:35 user devstack@n-api.service[61306]: X-Project-Name: tempest-AttachVolumeNegativeTest-636753786 Apr 23 03:55:35 user devstack@n-api.service[61306]: X-Role: reader,member Apr 23 03:55:35 user devstack@n-api.service[61306]: X-Roles: reader,member Apr 23 03:55:35 user devstack@n-api.service[61306]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/24fff486a500421397ecb935828582cd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/24fff486a500421397ecb935828582cd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/24fff486a500421397ecb935828582cd"}]}] Apr 23 03:55:35 user devstack@n-api.service[61306]: X-Tenant: tempest-AttachVolumeNegativeTest-636753786 Apr 23 03:55:35 user devstack@n-api.service[61306]: X-Tenant-Id: 24fff486a500421397ecb935828582cd Apr 23 03:55:35 user devstack@n-api.service[61306]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-636753786 Apr 23 03:55:35 user devstack@n-api.service[61306]: X-User: tempest-AttachVolumeNegativeTest-636753786-project-member Apr 23 03:55:35 user devstack@n-api.service[61306]: X-User-Domain-Id: default Apr 23 03:55:35 user devstack@n-api.service[61306]: X-User-Domain-Name: Default Apr 23 03:55:35 user devstack@n-api.service[61306]: X-User-Id: 0a2c459cad014b07b2613e5e261d88aa Apr 23 03:55:35 user devstack@n-api.service[61306]: X-User-Name: tempest-AttachVolumeNegativeTest-636753786-project-member Apr 23 03:55:35 user devstack@n-api.service[61306]: method: > Apr 23 03:55:35 user devstack@n-api.service[61306]: exception: Instance 3ec36a95-88ce-4ed1-9726-7e6d98674dec could not be found. Apr 23 03:55:35 user devstack@n-api.service[61306]: action_args: {'id': '3ec36a95-88ce-4ed1-9726-7e6d98674dec'} Apr 23 03:55:35 user devstack@n-api.service[61306]: {{(pid=61306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 23 03:55:35 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 23 03:55:35 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 23 03:55:35 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 23 03:55:35 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 23 03:55:35 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 23 03:55:35 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 23 03:55:35 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 23 03:55:35 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 23 03:55:35 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 23 03:55:35 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ec36a95-88ce-4ed1-9726-7e6d98674dec could not be found. Apr 23 03:55:35 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi Apr 23 03:55:35 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 23 03:55:35 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi Apr 23 03:55:35 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 23 03:55:35 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 23 03:55:35 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 23 03:55:35 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 23 03:55:35 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 23 03:55:35 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 23 03:55:35 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 23 03:55:35 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 23 03:55:35 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 23 03:55:35 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 23 03:55:35 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 23 03:55:35 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 23 03:55:35 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 23 03:55:35 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 23 03:55:35 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 23 03:55:35 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ec36a95-88ce-4ed1-9726-7e6d98674dec could not be found. Apr 23 03:55:35 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi Apr 23 03:55:35 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 23 03:55:35 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi Apr 23 03:55:35 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 23 03:55:35 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 23 03:55:35 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 23 03:55:35 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 23 03:55:35 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 23 03:55:35 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ec36a95-88ce-4ed1-9726-7e6d98674dec could not be found. Apr 23 03:55:35 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi Apr 23 03:55:35 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi [None req-0a742955-aa60-4ffd-9446-e7c440579008 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Returning 404 to user: Instance 3ec36a95-88ce-4ed1-9726-7e6d98674dec could not be found. {{(pid=61306) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 23 03:55:35 user devstack@n-api.service[61306]: INFO nova.api.openstack.requestlog [None req-0a742955-aa60-4ffd-9446-e7c440579008 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/3ec36a95-88ce-4ed1-9726-7e6d98674dec" status: 404 len: 111 microversion: 2.1 time: 0.032458 Apr 23 03:55:35 user devstack@n-api.service[61306]: [pid: 61306|app: 0|req: 109/332] 10.0.0.210 () {62 vars in 1316 bytes} [Sun Apr 23 03:55:35 2023] DELETE /compute/v2.1/servers/3ec36a95-88ce-4ed1-9726-7e6d98674dec => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 23 03:55:35 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi [None req-d3c6967f-338f-445e-a52d-c556fdf8d154 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Calling method '>' {{(pid=61307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 03:55:35 user devstack@n-api.service[61307]: DEBUG nova.compute.api [None req-d3c6967f-338f-445e-a52d-c556fdf8d154 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] [instance: 3ec36a95-88ce-4ed1-9726-7e6d98674dec] Fetching instance by UUID {{(pid=61307) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 23 03:55:35 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-d3c6967f-338f-445e-a52d-c556fdf8d154 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:55:35 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-d3c6967f-338f-445e-a52d-c556fdf8d154 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:55:35 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-d3c6967f-338f-445e-a52d-c556fdf8d154 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:55:35 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-d3c6967f-338f-445e-a52d-c556fdf8d154 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:55:35 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-d3c6967f-338f-445e-a52d-c556fdf8d154 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:55:35 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-d3c6967f-338f-445e-a52d-c556fdf8d154 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:55:35 user devstack@n-api.service[61307]: INFO nova.api.openstack.wsgi [None req-d3c6967f-338f-445e-a52d-c556fdf8d154 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] HTTP exception thrown: Instance 3ec36a95-88ce-4ed1-9726-7e6d98674dec could not be found. Apr 23 03:55:35 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi [None req-d3c6967f-338f-445e-a52d-c556fdf8d154 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Request method failure captured: Apr 23 03:55:35 user devstack@n-api.service[61307]: request: GET /compute/v2.1/servers/3ec36a95-88ce-4ed1-9726-7e6d98674dec HTTP/1.1 Apr 23 03:55:35 user devstack@n-api.service[61307]: Accept: application/json Apr 23 03:55:35 user devstack@n-api.service[61307]: Accept-Encoding: identity Apr 23 03:55:35 user devstack@n-api.service[61307]: Connection: close Apr 23 03:55:35 user devstack@n-api.service[61307]: Content-Length: 0 Apr 23 03:55:35 user devstack@n-api.service[61307]: Content-Type: application/json Apr 23 03:55:35 user devstack@n-api.service[61307]: Host: 10.0.0.210 Apr 23 03:55:35 user devstack@n-api.service[61307]: Openstack-System-Scope: None Apr 23 03:55:35 user devstack@n-api.service[61307]: User-Agent: python-urllib3/1.26.15 Apr 23 03:55:35 user devstack@n-api.service[61307]: X-Auth-Token: gAAAAABkRKpATlQnMMf7AtMe3Mh47zSQG6r9ePVSL6VRK9keRxp6Gc7HMzsz_tP8tNowWY8eeXU0HpQXr0oDoCaKK212ZCUgOzicpa4lTfvIkKDveVvGHNmHGf_zIb8xjb2T8bafSts450cf0HsaSh4WH6WoE9_DYKPyo7TkDFQdEsMNjyWu92U Apr 23 03:55:35 user devstack@n-api.service[61307]: X-Domain-Id: None Apr 23 03:55:35 user devstack@n-api.service[61307]: X-Domain-Name: None Apr 23 03:55:35 user devstack@n-api.service[61307]: X-Identity-Status: Confirmed Apr 23 03:55:35 user devstack@n-api.service[61307]: X-Is-Admin-Project: True Apr 23 03:55:35 user devstack@n-api.service[61307]: X-Project-Domain-Id: default Apr 23 03:55:35 user devstack@n-api.service[61307]: X-Project-Domain-Name: Default Apr 23 03:55:35 user devstack@n-api.service[61307]: X-Project-Id: 24fff486a500421397ecb935828582cd Apr 23 03:55:35 user devstack@n-api.service[61307]: X-Project-Name: tempest-AttachVolumeNegativeTest-636753786 Apr 23 03:55:35 user devstack@n-api.service[61307]: X-Role: reader,member Apr 23 03:55:35 user devstack@n-api.service[61307]: X-Roles: reader,member Apr 23 03:55:35 user devstack@n-api.service[61307]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/24fff486a500421397ecb935828582cd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/24fff486a500421397ecb935828582cd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/24fff486a500421397ecb935828582cd"}]}] Apr 23 03:55:35 user devstack@n-api.service[61307]: X-Tenant: tempest-AttachVolumeNegativeTest-636753786 Apr 23 03:55:35 user devstack@n-api.service[61307]: X-Tenant-Id: 24fff486a500421397ecb935828582cd Apr 23 03:55:35 user devstack@n-api.service[61307]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-636753786 Apr 23 03:55:35 user devstack@n-api.service[61307]: X-User: tempest-AttachVolumeNegativeTest-636753786-project-member Apr 23 03:55:35 user devstack@n-api.service[61307]: X-User-Domain-Id: default Apr 23 03:55:35 user devstack@n-api.service[61307]: X-User-Domain-Name: Default Apr 23 03:55:35 user devstack@n-api.service[61307]: X-User-Id: 0a2c459cad014b07b2613e5e261d88aa Apr 23 03:55:35 user devstack@n-api.service[61307]: X-User-Name: tempest-AttachVolumeNegativeTest-636753786-project-member Apr 23 03:55:35 user devstack@n-api.service[61307]: method: > Apr 23 03:55:35 user devstack@n-api.service[61307]: exception: Instance 3ec36a95-88ce-4ed1-9726-7e6d98674dec could not be found. Apr 23 03:55:35 user devstack@n-api.service[61307]: action_args: {'id': '3ec36a95-88ce-4ed1-9726-7e6d98674dec'} Apr 23 03:55:35 user devstack@n-api.service[61307]: {{(pid=61307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 23 03:55:35 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 23 03:55:35 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 23 03:55:35 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 23 03:55:35 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 23 03:55:35 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 23 03:55:35 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 23 03:55:35 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 23 03:55:35 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 23 03:55:35 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 23 03:55:35 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ec36a95-88ce-4ed1-9726-7e6d98674dec could not be found. Apr 23 03:55:35 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi Apr 23 03:55:35 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 23 03:55:35 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi Apr 23 03:55:35 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 23 03:55:35 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 23 03:55:35 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 23 03:55:35 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 23 03:55:35 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 23 03:55:35 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 23 03:55:35 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 23 03:55:35 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 23 03:55:35 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 23 03:55:35 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 23 03:55:35 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 23 03:55:35 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 23 03:55:35 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 23 03:55:35 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ec36a95-88ce-4ed1-9726-7e6d98674dec could not be found. Apr 23 03:55:35 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi Apr 23 03:55:35 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 23 03:55:35 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi Apr 23 03:55:35 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 23 03:55:35 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 23 03:55:35 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 23 03:55:35 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 23 03:55:35 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 23 03:55:35 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ec36a95-88ce-4ed1-9726-7e6d98674dec could not be found. Apr 23 03:55:35 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi Apr 23 03:55:35 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi [None req-d3c6967f-338f-445e-a52d-c556fdf8d154 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] Returning 404 to user: Instance 3ec36a95-88ce-4ed1-9726-7e6d98674dec could not be found. {{(pid=61307) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 23 03:55:35 user devstack@n-api.service[61307]: INFO nova.api.openstack.requestlog [None req-d3c6967f-338f-445e-a52d-c556fdf8d154 tempest-AttachVolumeNegativeTest-636753786 tempest-AttachVolumeNegativeTest-636753786-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3ec36a95-88ce-4ed1-9726-7e6d98674dec" status: 404 len: 111 microversion: 2.1 time: 0.027426 Apr 23 03:55:35 user devstack@n-api.service[61307]: [pid: 61307|app: 0|req: 111/333] 10.0.0.210 () {62 vars in 1313 bytes} [Sun Apr 23 03:55:35 2023] GET /compute/v2.1/servers/3ec36a95-88ce-4ed1-9726-7e6d98674dec => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 23 03:55:55 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi [None req-54776d9f-a033-4c4c-a2a8-945c144136d1 tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-1441120197", "imageRef": "e6127373-9931-4277-9458-eceef653ea1e", "flavorRef": "42", "block_device_mapping_v2": [{"boot_index": "0", "source_type": "image", "volume_size": 1, "uuid": "e6127373-9931-4277-9458-eceef653ea1e", "destination_type": "volume"}], "networks": [{"uuid": "25de9e6c-4c02-4658-b076-466681d96605"}]}} {{(pid=61308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 03:55:55 user devstack@n-api.service[61308]: DEBUG dbcounter [-] [61308] Writing DB stats nova_api:SELECT=7,nova_api:DELETE=1 {{(pid=61308) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:55:55 user devstack@n-api.service[61308]: DEBUG dbcounter [-] [61308] Writing DB stats nova_cell1:SELECT=4 {{(pid=61308) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:55:56 user devstack@n-api.service[61308]: DEBUG nova.network.neutron [None req-54776d9f-a033-4c4c-a2a8-945c144136d1 tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] validate_networks() for [('25de9e6c-4c02-4658-b076-466681d96605', None, None, None, None, None)] {{(pid=61308) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 23 03:55:56 user devstack@n-api.service[61308]: DEBUG nova.virt.hardware [None req-54776d9f-a033-4c4c-a2a8-945c144136d1 tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Flavor limits 0:0:0 {{(pid=61308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 23 03:55:56 user devstack@n-api.service[61308]: DEBUG nova.virt.hardware [None req-54776d9f-a033-4c4c-a2a8-945c144136d1 tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Image limits 0:0:0 {{(pid=61308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 23 03:55:56 user devstack@n-api.service[61308]: DEBUG nova.virt.hardware [None req-54776d9f-a033-4c4c-a2a8-945c144136d1 tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Flavor pref 0:0:0 {{(pid=61308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 23 03:55:56 user devstack@n-api.service[61308]: DEBUG nova.virt.hardware [None req-54776d9f-a033-4c4c-a2a8-945c144136d1 tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Image pref 0:0:0 {{(pid=61308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 23 03:55:56 user devstack@n-api.service[61308]: DEBUG nova.virt.hardware [None req-54776d9f-a033-4c4c-a2a8-945c144136d1 tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 23 03:55:56 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-54776d9f-a033-4c4c-a2a8-945c144136d1 tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:55:56 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-54776d9f-a033-4c4c-a2a8-945c144136d1 tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:55:56 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-54776d9f-a033-4c4c-a2a8-945c144136d1 tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:55:56 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-54776d9f-a033-4c4c-a2a8-945c144136d1 tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:55:56 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-54776d9f-a033-4c4c-a2a8-945c144136d1 tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:55:56 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-54776d9f-a033-4c4c-a2a8-945c144136d1 tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:55:56 user devstack@n-api.service[61308]: DEBUG nova.quota [None req-54776d9f-a033-4c4c-a2a8-945c144136d1 tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Getting quotas for project a79e09b1c4ae4cc5ab11c3e56ee4f0d9. Resources: {'ram', 'instances', 'cores'} {{(pid=61308) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 23 03:55:56 user devstack@n-api.service[61308]: DEBUG nova.quota [None req-54776d9f-a033-4c4c-a2a8-945c144136d1 tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Getting quotas for user 99495726467944c38620831fc93e2856 and project a79e09b1c4ae4cc5ab11c3e56ee4f0d9. Resources: {'ram', 'instances', 'cores'} {{(pid=61308) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 23 03:55:56 user devstack@n-api.service[61308]: DEBUG nova.compute.api [None req-54776d9f-a033-4c4c-a2a8-945c144136d1 tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Going to run 1 instances... {{(pid=61308) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 23 03:55:56 user devstack@n-api.service[61308]: DEBUG nova.compute.api [None req-54776d9f-a033-4c4c-a2a8-945c144136d1 tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] [instance: a3378117-215b-457c-b9ba-5099c5810e4d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e6127373-9931-4277-9458-eceef653ea1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=61308) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 23 03:55:56 user devstack@n-api.service[61308]: INFO nova.api.openstack.requestlog [None req-54776d9f-a033-4c4c-a2a8-945c144136d1 tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.695026 Apr 23 03:55:56 user devstack@n-api.service[61308]: [pid: 61308|app: 0|req: 114/334] 10.0.0.210 () {66 vars in 1265 bytes} [Sun Apr 23 03:55:55 2023] POST /compute/v2.1/servers => generated 378 bytes in 697 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 23 03:55:56 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi [None req-05f2d9cd-0d51-43b6-8732-85e3277a0a7b tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Calling method '>' {{(pid=61306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 03:55:56 user devstack@n-api.service[61306]: DEBUG nova.compute.api [None req-05f2d9cd-0d51-43b6-8732-85e3277a0a7b tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] [instance: a3378117-215b-457c-b9ba-5099c5810e4d] Fetching instance by UUID {{(pid=61306) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 23 03:55:56 user devstack@n-api.service[61306]: DEBUG dbcounter [-] [61306] Writing DB stats nova_api:SELECT=6 {{(pid=61306) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:55:56 user devstack@n-api.service[61306]: DEBUG dbcounter [-] [61306] Writing DB stats nova_cell1:SELECT=6 {{(pid=61306) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:55:56 user devstack@n-api.service[61306]: DEBUG nova.policy [None req-05f2d9cd-0d51-43b6-8732-85e3277a0a7b tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99495726467944c38620831fc93e2856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79e09b1c4ae4cc5ab11c3e56ee4f0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61306) authorize /opt/stack/nova/nova/policy.py:203}} Apr 23 03:55:56 user devstack@n-api.service[61306]: DEBUG nova.policy [None req-05f2d9cd-0d51-43b6-8732-85e3277a0a7b tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99495726467944c38620831fc93e2856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79e09b1c4ae4cc5ab11c3e56ee4f0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61306) authorize /opt/stack/nova/nova/policy.py:203}} Apr 23 03:55:56 user devstack@n-api.service[61306]: DEBUG nova.policy [None req-05f2d9cd-0d51-43b6-8732-85e3277a0a7b tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99495726467944c38620831fc93e2856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79e09b1c4ae4cc5ab11c3e56ee4f0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61306) authorize /opt/stack/nova/nova/policy.py:203}} Apr 23 03:55:56 user devstack@n-api.service[61306]: INFO nova.api.openstack.requestlog [None req-05f2d9cd-0d51-43b6-8732-85e3277a0a7b tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a3378117-215b-457c-b9ba-5099c5810e4d" status: 200 len: 1395 microversion: 2.87 time: 0.074879 Apr 23 03:55:56 user devstack@n-api.service[61306]: [pid: 61306|app: 0|req: 110/335] 10.0.0.210 () {64 vars in 1354 bytes} [Sun Apr 23 03:55:56 2023] GET /compute/v2.1/servers/a3378117-215b-457c-b9ba-5099c5810e4d => generated 1395 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 23 03:55:58 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi [req-9fb46229-04f3-495b-81bb-bbd17196e754 req-798bcddc-ecf9-425f-a74e-8016380f9917 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3378117-215b-457c-b9ba-5099c5810e4d", "tag": "a398adce-d4fb-46e2-a8b1-38f906316a55"}]} {{(pid=61307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 03:55:58 user devstack@n-api.service[61307]: DEBUG dbcounter [-] [61307] Writing DB stats nova_cell0:SELECT=4 {{(pid=61307) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:55:58 user devstack@n-api.service[61307]: DEBUG dbcounter [-] [61307] Writing DB stats nova_api:SELECT=18,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=61307) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:55:58 user devstack@n-api.service[61307]: DEBUG dbcounter [-] [61307] Writing DB stats nova_cell1:SELECT=4 {{(pid=61307) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:55:58 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [req-9fb46229-04f3-495b-81bb-bbd17196e754 req-798bcddc-ecf9-425f-a74e-8016380f9917 service nova] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:55:58 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [req-9fb46229-04f3-495b-81bb-bbd17196e754 req-798bcddc-ecf9-425f-a74e-8016380f9917 service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:55:58 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [req-9fb46229-04f3-495b-81bb-bbd17196e754 req-798bcddc-ecf9-425f-a74e-8016380f9917 service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:55:59 user devstack@n-api.service[61307]: INFO nova.api.openstack.compute.server_external_events [req-9fb46229-04f3-495b-81bb-bbd17196e754 req-798bcddc-ecf9-425f-a74e-8016380f9917 service nova] Creating event network-changed:a398adce-d4fb-46e2-a8b1-38f906316a55 for instance a3378117-215b-457c-b9ba-5099c5810e4d on user Apr 23 03:55:59 user devstack@n-api.service[61307]: INFO nova.api.openstack.requestlog [req-9fb46229-04f3-495b-81bb-bbd17196e754 req-798bcddc-ecf9-425f-a74e-8016380f9917 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032519 Apr 23 03:55:59 user devstack@n-api.service[61307]: [pid: 61307|app: 0|req: 112/336] 10.0.0.210 () {68 vars in 1394 bytes} [Sun Apr 23 03:55:58 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 23 03:56:01 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi [req-fb986401-9fc2-4f2b-9aa4-4fd5ee2d668e req-8d43a268-f54f-47a4-a276-e009f907a84c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3378117-215b-457c-b9ba-5099c5810e4d", "name": "network-vif-deleted", "tag": "a398adce-d4fb-46e2-a8b1-38f906316a55"}]} {{(pid=61308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 03:56:01 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [req-fb986401-9fc2-4f2b-9aa4-4fd5ee2d668e req-8d43a268-f54f-47a4-a276-e009f907a84c service nova] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:56:01 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [req-fb986401-9fc2-4f2b-9aa4-4fd5ee2d668e req-8d43a268-f54f-47a4-a276-e009f907a84c service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:56:01 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [req-fb986401-9fc2-4f2b-9aa4-4fd5ee2d668e req-8d43a268-f54f-47a4-a276-e009f907a84c service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:56:01 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.compute.server_external_events [req-fb986401-9fc2-4f2b-9aa4-4fd5ee2d668e req-8d43a268-f54f-47a4-a276-e009f907a84c service nova] Unable to find a host for instance a3378117-215b-457c-b9ba-5099c5810e4d. Dropping event network-vif-deleted {{(pid=61308) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Apr 23 03:56:01 user devstack@n-api.service[61308]: INFO nova.api.openstack.requestlog [req-fb986401-9fc2-4f2b-9aa4-4fd5ee2d668e req-8d43a268-f54f-47a4-a276-e009f907a84c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.029816 Apr 23 03:56:01 user devstack@n-api.service[61308]: [pid: 61308|app: 0|req: 115/337] 10.0.0.210 () {68 vars in 1394 bytes} [Sun Apr 23 03:56:01 2023] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 31 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Apr 23 03:56:08 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi [None req-c8f2f1a6-434c-405b-a4be-83dfabe9774c tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] Calling method '>' {{(pid=61306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 03:56:08 user devstack@n-api.service[61306]: DEBUG nova.compute.api [None req-c8f2f1a6-434c-405b-a4be-83dfabe9774c tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] [instance: 954f41b2-5c67-41a4-b38b-ebf3ad60cac7] Fetching instance by UUID {{(pid=61306) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 23 03:56:08 user devstack@n-api.service[61306]: DEBUG dbcounter [-] [61306] Writing DB stats nova_cell0:SELECT=2 {{(pid=61306) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:56:08 user devstack@n-api.service[61306]: DEBUG dbcounter [-] [61306] Writing DB stats nova_api:SELECT=6 {{(pid=61306) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:56:08 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-c8f2f1a6-434c-405b-a4be-83dfabe9774c tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:56:08 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-c8f2f1a6-434c-405b-a4be-83dfabe9774c tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:56:08 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-c8f2f1a6-434c-405b-a4be-83dfabe9774c tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:56:08 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-c8f2f1a6-434c-405b-a4be-83dfabe9774c tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:56:08 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-c8f2f1a6-434c-405b-a4be-83dfabe9774c tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:56:08 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-c8f2f1a6-434c-405b-a4be-83dfabe9774c tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:56:08 user devstack@n-api.service[61306]: INFO nova.api.openstack.wsgi [None req-c8f2f1a6-434c-405b-a4be-83dfabe9774c tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] HTTP exception thrown: Instance 954f41b2-5c67-41a4-b38b-ebf3ad60cac7 could not be found. Apr 23 03:56:08 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi [None req-c8f2f1a6-434c-405b-a4be-83dfabe9774c tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] Request method failure captured: Apr 23 03:56:08 user devstack@n-api.service[61306]: request: GET /compute/v2.1/servers/954f41b2-5c67-41a4-b38b-ebf3ad60cac7 HTTP/1.1 Apr 23 03:56:08 user devstack@n-api.service[61306]: Accept: application/json Apr 23 03:56:08 user devstack@n-api.service[61306]: Accept-Encoding: identity Apr 23 03:56:08 user devstack@n-api.service[61306]: Connection: close Apr 23 03:56:08 user devstack@n-api.service[61306]: Content-Length: 0 Apr 23 03:56:08 user devstack@n-api.service[61306]: Content-Type: application/json Apr 23 03:56:08 user devstack@n-api.service[61306]: Host: 10.0.0.210 Apr 23 03:56:08 user devstack@n-api.service[61306]: Openstack-System-Scope: None Apr 23 03:56:08 user devstack@n-api.service[61306]: User-Agent: python-urllib3/1.26.15 Apr 23 03:56:08 user devstack@n-api.service[61306]: X-Auth-Token: gAAAAABkRKpAcfusp_X86p1MSfci9tNvZmt1cwa52rRGOnaTaoP8QjKskHSo3tjD5dzZOwsinXaMtNLkyl9JE191mrYNKhm6MiSjhUsMWac1BVBYhHbUyV4w64nXRWKgdnW88_mKbemAsyFJtBjerrwdO0YdC_c7YeAk8XccIBaZwhkF7Bcidlc Apr 23 03:56:08 user devstack@n-api.service[61306]: X-Domain-Id: None Apr 23 03:56:08 user devstack@n-api.service[61306]: X-Domain-Name: None Apr 23 03:56:08 user devstack@n-api.service[61306]: X-Identity-Status: Confirmed Apr 23 03:56:08 user devstack@n-api.service[61306]: X-Is-Admin-Project: True Apr 23 03:56:08 user devstack@n-api.service[61306]: X-Project-Domain-Id: default Apr 23 03:56:08 user devstack@n-api.service[61306]: X-Project-Domain-Name: Default Apr 23 03:56:08 user devstack@n-api.service[61306]: X-Project-Id: 6f44fe9ba07e4e2f925d1a8952356e04 Apr 23 03:56:08 user devstack@n-api.service[61306]: X-Project-Name: tempest-ServerActionsTestJSON-1398779434 Apr 23 03:56:08 user devstack@n-api.service[61306]: X-Role: reader,member Apr 23 03:56:08 user devstack@n-api.service[61306]: X-Roles: reader,member Apr 23 03:56:08 user devstack@n-api.service[61306]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6f44fe9ba07e4e2f925d1a8952356e04"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6f44fe9ba07e4e2f925d1a8952356e04"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/6f44fe9ba07e4e2f925d1a8952356e04"}]}] Apr 23 03:56:08 user devstack@n-api.service[61306]: X-Tenant: tempest-ServerActionsTestJSON-1398779434 Apr 23 03:56:08 user devstack@n-api.service[61306]: X-Tenant-Id: 6f44fe9ba07e4e2f925d1a8952356e04 Apr 23 03:56:08 user devstack@n-api.service[61306]: X-Tenant-Name: tempest-ServerActionsTestJSON-1398779434 Apr 23 03:56:08 user devstack@n-api.service[61306]: X-User: tempest-ServerActionsTestJSON-1398779434-project-member Apr 23 03:56:08 user devstack@n-api.service[61306]: X-User-Domain-Id: default Apr 23 03:56:08 user devstack@n-api.service[61306]: X-User-Domain-Name: Default Apr 23 03:56:08 user devstack@n-api.service[61306]: X-User-Id: cdc8fe94058c46c28d4b3f16dc1e77ed Apr 23 03:56:08 user devstack@n-api.service[61306]: X-User-Name: tempest-ServerActionsTestJSON-1398779434-project-member Apr 23 03:56:08 user devstack@n-api.service[61306]: method: > Apr 23 03:56:08 user devstack@n-api.service[61306]: exception: Instance 954f41b2-5c67-41a4-b38b-ebf3ad60cac7 could not be found. Apr 23 03:56:08 user devstack@n-api.service[61306]: action_args: {'id': '954f41b2-5c67-41a4-b38b-ebf3ad60cac7'} Apr 23 03:56:08 user devstack@n-api.service[61306]: {{(pid=61306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 23 03:56:08 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 23 03:56:08 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 23 03:56:08 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 23 03:56:08 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 23 03:56:08 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 23 03:56:08 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 23 03:56:08 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 23 03:56:08 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 23 03:56:08 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 23 03:56:08 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 954f41b2-5c67-41a4-b38b-ebf3ad60cac7 could not be found. Apr 23 03:56:08 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi Apr 23 03:56:08 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 23 03:56:08 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi Apr 23 03:56:08 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 23 03:56:08 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 23 03:56:08 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 23 03:56:08 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 23 03:56:08 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 23 03:56:08 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 23 03:56:08 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 23 03:56:08 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 23 03:56:08 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 23 03:56:08 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 23 03:56:08 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 23 03:56:08 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 23 03:56:08 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 23 03:56:08 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 954f41b2-5c67-41a4-b38b-ebf3ad60cac7 could not be found. Apr 23 03:56:08 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi Apr 23 03:56:08 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 23 03:56:08 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi Apr 23 03:56:08 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 23 03:56:08 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 23 03:56:08 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 23 03:56:08 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 23 03:56:08 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 23 03:56:08 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 954f41b2-5c67-41a4-b38b-ebf3ad60cac7 could not be found. Apr 23 03:56:08 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi Apr 23 03:56:08 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi [None req-c8f2f1a6-434c-405b-a4be-83dfabe9774c tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] Returning 404 to user: Instance 954f41b2-5c67-41a4-b38b-ebf3ad60cac7 could not be found. {{(pid=61306) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 23 03:56:08 user devstack@n-api.service[61306]: INFO nova.api.openstack.requestlog [None req-c8f2f1a6-434c-405b-a4be-83dfabe9774c tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] 10.0.0.210 "GET /compute/v2.1/servers/954f41b2-5c67-41a4-b38b-ebf3ad60cac7" status: 404 len: 111 microversion: 2.1 time: 0.034840 Apr 23 03:56:08 user devstack@n-api.service[61306]: [pid: 61306|app: 0|req: 111/338] 10.0.0.210 () {62 vars in 1313 bytes} [Sun Apr 23 03:56:08 2023] GET /compute/v2.1/servers/954f41b2-5c67-41a4-b38b-ebf3ad60cac7 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 23 03:56:08 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi [None req-71ac615b-00ea-4916-a7fd-c7c7dc31bcd7 tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] Calling method '.version_select at 0x7f21e10ccf70>' {{(pid=61307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 03:56:08 user devstack@n-api.service[61307]: INFO nova.api.openstack.requestlog [None req-71ac615b-00ea-4916-a7fd-c7c7dc31bcd7 tempest-ServerActionsTestJSON-1398779434 tempest-ServerActionsTestJSON-1398779434-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1222563018" status: 202 len: 0 microversion: 2.1 time: 0.023005 Apr 23 03:56:08 user devstack@n-api.service[61307]: [pid: 61307|app: 0|req: 113/339] 10.0.0.210 () {62 vars in 1298 bytes} [Sun Apr 23 03:56:08 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1222563018 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 23 03:56:19 user devstack@n-api.service[61308]: DEBUG dbcounter [-] [61308] Writing DB stats nova_cell0:SELECT=2 {{(pid=61308) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:56:19 user devstack@n-api.service[61308]: DEBUG dbcounter [-] [61308] Writing DB stats nova_cell0:SELECT=6 {{(pid=61308) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:56:19 user devstack@n-api.service[61308]: DEBUG dbcounter [-] [61308] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=3 {{(pid=61308) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:56:19 user devstack@n-api.service[61308]: DEBUG dbcounter [-] [61308] Writing DB stats nova_cell1:SELECT=4 {{(pid=61308) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:56:19 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi [None req-862e2bc2-53d4-4db7-bc09-c54da19c8013 tempest-ServersNegativeTestJSON-1115615559 tempest-ServersNegativeTestJSON-1115615559-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1352466124", "imageRef": "e6127373-9931-4277-9458-eceef653ea1e", "flavorRef": "42", "networks": [{"uuid": "083ef998-5361-46b7-827f-d0f086e9e552"}]}} {{(pid=61308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 03:56:19 user devstack@n-api.service[61308]: DEBUG nova.network.neutron [None req-862e2bc2-53d4-4db7-bc09-c54da19c8013 tempest-ServersNegativeTestJSON-1115615559 tempest-ServersNegativeTestJSON-1115615559-project-member] validate_networks() for [('083ef998-5361-46b7-827f-d0f086e9e552', None, None, None, None, None)] {{(pid=61308) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 23 03:56:20 user devstack@n-api.service[61308]: DEBUG nova.virt.hardware [None req-862e2bc2-53d4-4db7-bc09-c54da19c8013 tempest-ServersNegativeTestJSON-1115615559 tempest-ServersNegativeTestJSON-1115615559-project-member] Flavor limits 0:0:0 {{(pid=61308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 23 03:56:20 user devstack@n-api.service[61308]: DEBUG nova.virt.hardware [None req-862e2bc2-53d4-4db7-bc09-c54da19c8013 tempest-ServersNegativeTestJSON-1115615559 tempest-ServersNegativeTestJSON-1115615559-project-member] Image limits 0:0:0 {{(pid=61308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 23 03:56:20 user devstack@n-api.service[61308]: DEBUG nova.virt.hardware [None req-862e2bc2-53d4-4db7-bc09-c54da19c8013 tempest-ServersNegativeTestJSON-1115615559 tempest-ServersNegativeTestJSON-1115615559-project-member] Flavor pref 0:0:0 {{(pid=61308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 23 03:56:20 user devstack@n-api.service[61308]: DEBUG nova.virt.hardware [None req-862e2bc2-53d4-4db7-bc09-c54da19c8013 tempest-ServersNegativeTestJSON-1115615559 tempest-ServersNegativeTestJSON-1115615559-project-member] Image pref 0:0:0 {{(pid=61308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 23 03:56:20 user devstack@n-api.service[61308]: DEBUG nova.virt.hardware [None req-862e2bc2-53d4-4db7-bc09-c54da19c8013 tempest-ServersNegativeTestJSON-1115615559 tempest-ServersNegativeTestJSON-1115615559-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 23 03:56:20 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-862e2bc2-53d4-4db7-bc09-c54da19c8013 tempest-ServersNegativeTestJSON-1115615559 tempest-ServersNegativeTestJSON-1115615559-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:56:20 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-862e2bc2-53d4-4db7-bc09-c54da19c8013 tempest-ServersNegativeTestJSON-1115615559 tempest-ServersNegativeTestJSON-1115615559-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:56:20 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-862e2bc2-53d4-4db7-bc09-c54da19c8013 tempest-ServersNegativeTestJSON-1115615559 tempest-ServersNegativeTestJSON-1115615559-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:56:20 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-862e2bc2-53d4-4db7-bc09-c54da19c8013 tempest-ServersNegativeTestJSON-1115615559 tempest-ServersNegativeTestJSON-1115615559-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:56:20 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-862e2bc2-53d4-4db7-bc09-c54da19c8013 tempest-ServersNegativeTestJSON-1115615559 tempest-ServersNegativeTestJSON-1115615559-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:56:20 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-862e2bc2-53d4-4db7-bc09-c54da19c8013 tempest-ServersNegativeTestJSON-1115615559 tempest-ServersNegativeTestJSON-1115615559-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:56:20 user devstack@n-api.service[61308]: DEBUG nova.quota [None req-862e2bc2-53d4-4db7-bc09-c54da19c8013 tempest-ServersNegativeTestJSON-1115615559 tempest-ServersNegativeTestJSON-1115615559-project-member] Getting quotas for project 39d6cb4cfcb2413f8039ee9febf1c046. Resources: {'ram', 'instances', 'cores'} {{(pid=61308) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 23 03:56:20 user devstack@n-api.service[61308]: DEBUG nova.quota [None req-862e2bc2-53d4-4db7-bc09-c54da19c8013 tempest-ServersNegativeTestJSON-1115615559 tempest-ServersNegativeTestJSON-1115615559-project-member] Getting quotas for user 45d9ae4a3b00492fa2fc16a22a34df09 and project 39d6cb4cfcb2413f8039ee9febf1c046. Resources: {'ram', 'instances', 'cores'} {{(pid=61308) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 23 03:56:20 user devstack@n-api.service[61308]: DEBUG nova.compute.api [None req-862e2bc2-53d4-4db7-bc09-c54da19c8013 tempest-ServersNegativeTestJSON-1115615559 tempest-ServersNegativeTestJSON-1115615559-project-member] Going to run 1 instances... {{(pid=61308) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 23 03:56:20 user devstack@n-api.service[61308]: DEBUG nova.compute.api [None req-862e2bc2-53d4-4db7-bc09-c54da19c8013 tempest-ServersNegativeTestJSON-1115615559 tempest-ServersNegativeTestJSON-1115615559-project-member] [instance: ee89a9d5-0507-475c-bea2-e02e34d15710] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e6127373-9931-4277-9458-eceef653ea1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61308) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 23 03:56:20 user devstack@n-api.service[61308]: INFO nova.api.openstack.requestlog [None req-862e2bc2-53d4-4db7-bc09-c54da19c8013 tempest-ServersNegativeTestJSON-1115615559 tempest-ServersNegativeTestJSON-1115615559-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.984039 Apr 23 03:56:20 user devstack@n-api.service[61308]: [pid: 61308|app: 0|req: 116/340] 10.0.0.210 () {64 vars in 1224 bytes} [Sun Apr 23 03:56:19 2023] POST /compute/v2.1/servers => generated 378 bytes in 986 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 23 03:56:20 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi [None req-871e4ba3-f3a7-43b6-b583-f4a92ddefa66 tempest-ServersNegativeTestJSON-1115615559 tempest-ServersNegativeTestJSON-1115615559-project-member] Calling method '>' {{(pid=61306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 03:56:20 user devstack@n-api.service[61306]: DEBUG nova.compute.api [None req-871e4ba3-f3a7-43b6-b583-f4a92ddefa66 tempest-ServersNegativeTestJSON-1115615559 tempest-ServersNegativeTestJSON-1115615559-project-member] [instance: ee89a9d5-0507-475c-bea2-e02e34d15710] Fetching instance by UUID {{(pid=61306) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 23 03:56:20 user devstack@n-api.service[61306]: DEBUG dbcounter [-] [61306] Writing DB stats nova_api:SELECT=2 {{(pid=61306) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:56:20 user devstack@n-api.service[61306]: DEBUG dbcounter [-] [61306] Writing DB stats nova_cell1:SELECT=2 {{(pid=61306) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:56:20 user devstack@n-api.service[61306]: DEBUG nova.policy [None req-871e4ba3-f3a7-43b6-b583-f4a92ddefa66 tempest-ServersNegativeTestJSON-1115615559 tempest-ServersNegativeTestJSON-1115615559-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d9ae4a3b00492fa2fc16a22a34df09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39d6cb4cfcb2413f8039ee9febf1c046', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61306) authorize /opt/stack/nova/nova/policy.py:203}} Apr 23 03:56:20 user devstack@n-api.service[61306]: INFO nova.api.openstack.requestlog [None req-871e4ba3-f3a7-43b6-b583-f4a92ddefa66 tempest-ServersNegativeTestJSON-1115615559 tempest-ServersNegativeTestJSON-1115615559-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ee89a9d5-0507-475c-bea2-e02e34d15710" status: 200 len: 1211 microversion: 2.1 time: 0.123882 Apr 23 03:56:20 user devstack@n-api.service[61306]: [pid: 61306|app: 0|req: 112/341] 10.0.0.210 () {62 vars in 1313 bytes} [Sun Apr 23 03:56:20 2023] GET /compute/v2.1/servers/ee89a9d5-0507-475c-bea2-e02e34d15710 => generated 1211 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 23 03:56:23 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi [req-b40aa04c-05bd-43af-a288-2b7e57327764 req-3500009f-3368-4dd8-ad51-7b954eab6762 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee89a9d5-0507-475c-bea2-e02e34d15710", "tag": "8948ed3a-de42-41ef-b7ca-c34a2d405b09"}]} {{(pid=61307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 03:56:23 user devstack@n-api.service[61307]: DEBUG dbcounter [-] [61307] Writing DB stats nova_cell1:SELECT=2 {{(pid=61307) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:56:23 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [req-b40aa04c-05bd-43af-a288-2b7e57327764 req-3500009f-3368-4dd8-ad51-7b954eab6762 service nova] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:56:23 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [req-b40aa04c-05bd-43af-a288-2b7e57327764 req-3500009f-3368-4dd8-ad51-7b954eab6762 service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:56:23 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [req-b40aa04c-05bd-43af-a288-2b7e57327764 req-3500009f-3368-4dd8-ad51-7b954eab6762 service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:56:23 user devstack@n-api.service[61307]: INFO nova.api.openstack.compute.server_external_events [req-b40aa04c-05bd-43af-a288-2b7e57327764 req-3500009f-3368-4dd8-ad51-7b954eab6762 service nova] Creating event network-changed:8948ed3a-de42-41ef-b7ca-c34a2d405b09 for instance ee89a9d5-0507-475c-bea2-e02e34d15710 on user Apr 23 03:56:23 user devstack@n-api.service[61307]: INFO nova.api.openstack.requestlog [req-b40aa04c-05bd-43af-a288-2b7e57327764 req-3500009f-3368-4dd8-ad51-7b954eab6762 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035623 Apr 23 03:56:23 user devstack@n-api.service[61307]: [pid: 61307|app: 0|req: 114/342] 10.0.0.210 () {68 vars in 1394 bytes} [Sun Apr 23 03:56:23 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 23 03:56:25 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi [req-71dddd89-db86-475f-8046-200902a259ee req-1f673c24-6409-4701-9f0b-a140a9ca565d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee89a9d5-0507-475c-bea2-e02e34d15710", "name": "network-vif-plugged", "status": "completed", "tag": "8948ed3a-de42-41ef-b7ca-c34a2d405b09"}]} {{(pid=61308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 03:56:25 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [req-71dddd89-db86-475f-8046-200902a259ee req-1f673c24-6409-4701-9f0b-a140a9ca565d service nova] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:56:25 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [req-71dddd89-db86-475f-8046-200902a259ee req-1f673c24-6409-4701-9f0b-a140a9ca565d service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:56:25 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [req-71dddd89-db86-475f-8046-200902a259ee req-1f673c24-6409-4701-9f0b-a140a9ca565d service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:56:25 user devstack@n-api.service[61308]: INFO nova.api.openstack.compute.server_external_events [req-71dddd89-db86-475f-8046-200902a259ee req-1f673c24-6409-4701-9f0b-a140a9ca565d service nova] Creating event network-vif-plugged:8948ed3a-de42-41ef-b7ca-c34a2d405b09 for instance ee89a9d5-0507-475c-bea2-e02e34d15710 on user Apr 23 03:56:25 user devstack@n-api.service[61308]: INFO nova.api.openstack.requestlog [req-71dddd89-db86-475f-8046-200902a259ee req-1f673c24-6409-4701-9f0b-a140a9ca565d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031157 Apr 23 03:56:25 user devstack@n-api.service[61308]: [pid: 61308|app: 0|req: 117/343] 10.0.0.210 () {68 vars in 1394 bytes} [Sun Apr 23 03:56:25 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 23 03:56:27 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi [req-2c1a2488-bb4d-4311-bf04-e88b85d9b5bb req-e6beaa1e-d692-4f30-9210-2eeb81c33f37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee89a9d5-0507-475c-bea2-e02e34d15710", "name": "network-vif-plugged", "status": "completed", "tag": "8948ed3a-de42-41ef-b7ca-c34a2d405b09"}]} {{(pid=61306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 03:56:27 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [req-2c1a2488-bb4d-4311-bf04-e88b85d9b5bb req-e6beaa1e-d692-4f30-9210-2eeb81c33f37 service nova] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:56:27 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [req-2c1a2488-bb4d-4311-bf04-e88b85d9b5bb req-e6beaa1e-d692-4f30-9210-2eeb81c33f37 service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:56:27 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [req-2c1a2488-bb4d-4311-bf04-e88b85d9b5bb req-e6beaa1e-d692-4f30-9210-2eeb81c33f37 service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:56:27 user devstack@n-api.service[61306]: INFO nova.api.openstack.compute.server_external_events [req-2c1a2488-bb4d-4311-bf04-e88b85d9b5bb req-e6beaa1e-d692-4f30-9210-2eeb81c33f37 service nova] Creating event network-vif-plugged:8948ed3a-de42-41ef-b7ca-c34a2d405b09 for instance ee89a9d5-0507-475c-bea2-e02e34d15710 on user Apr 23 03:56:27 user devstack@n-api.service[61306]: INFO nova.api.openstack.requestlog [req-2c1a2488-bb4d-4311-bf04-e88b85d9b5bb req-e6beaa1e-d692-4f30-9210-2eeb81c33f37 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036387 Apr 23 03:56:27 user devstack@n-api.service[61306]: [pid: 61306|app: 0|req: 113/344] 10.0.0.210 () {68 vars in 1394 bytes} [Sun Apr 23 03:56:27 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 23 03:56:46 user devstack@n-api.service[61307]: DEBUG dbcounter [-] [61307] Writing DB stats nova_api:SELECT=7,nova_api:DELETE=1 {{(pid=61307) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:56:46 user devstack@n-api.service[61307]: DEBUG dbcounter [-] [61307] Writing DB stats nova_cell1:SELECT=2 {{(pid=61307) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:56:46 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi [None req-2ee28640-96db-4b59-9585-d41563bc73de tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Calling method '>' {{(pid=61307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 03:56:46 user devstack@n-api.service[61307]: DEBUG nova.compute.api [None req-2ee28640-96db-4b59-9585-d41563bc73de tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] [instance: a3378117-215b-457c-b9ba-5099c5810e4d] Fetching instance by UUID {{(pid=61307) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 23 03:56:46 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-2ee28640-96db-4b59-9585-d41563bc73de tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:56:46 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-2ee28640-96db-4b59-9585-d41563bc73de tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:56:46 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-2ee28640-96db-4b59-9585-d41563bc73de tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:56:46 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-2ee28640-96db-4b59-9585-d41563bc73de tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:56:46 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-2ee28640-96db-4b59-9585-d41563bc73de tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:56:46 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-2ee28640-96db-4b59-9585-d41563bc73de tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:56:46 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-2ee28640-96db-4b59-9585-d41563bc73de tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:56:46 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-2ee28640-96db-4b59-9585-d41563bc73de tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:56:46 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-2ee28640-96db-4b59-9585-d41563bc73de tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:56:46 user devstack@n-api.service[61307]: DEBUG nova.objects.instance [None req-2ee28640-96db-4b59-9585-d41563bc73de tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Lazy-loading 'fault' on Instance uuid a3378117-215b-457c-b9ba-5099c5810e4d {{(pid=61307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 23 03:56:46 user devstack@n-api.service[61307]: DEBUG nova.policy [None req-2ee28640-96db-4b59-9585-d41563bc73de tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99495726467944c38620831fc93e2856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79e09b1c4ae4cc5ab11c3e56ee4f0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61307) authorize /opt/stack/nova/nova/policy.py:203}} Apr 23 03:56:46 user devstack@n-api.service[61307]: DEBUG nova.policy [None req-2ee28640-96db-4b59-9585-d41563bc73de tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99495726467944c38620831fc93e2856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79e09b1c4ae4cc5ab11c3e56ee4f0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61307) authorize /opt/stack/nova/nova/policy.py:203}} Apr 23 03:56:46 user devstack@n-api.service[61307]: DEBUG nova.policy [None req-2ee28640-96db-4b59-9585-d41563bc73de tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99495726467944c38620831fc93e2856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79e09b1c4ae4cc5ab11c3e56ee4f0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61307) authorize /opt/stack/nova/nova/policy.py:203}} Apr 23 03:56:46 user devstack@n-api.service[61307]: INFO nova.api.openstack.requestlog [None req-2ee28640-96db-4b59-9585-d41563bc73de tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a3378117-215b-457c-b9ba-5099c5810e4d" status: 200 len: 1650 microversion: 2.87 time: 0.174928 Apr 23 03:56:46 user devstack@n-api.service[61307]: [pid: 61307|app: 0|req: 115/345] 10.0.0.210 () {64 vars in 1354 bytes} [Sun Apr 23 03:56:46 2023] GET /compute/v2.1/servers/a3378117-215b-457c-b9ba-5099c5810e4d => generated 1650 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 23 03:56:46 user devstack@n-api.service[61308]: DEBUG dbcounter [-] [61308] Writing DB stats nova_cell0:SELECT=2 {{(pid=61308) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:56:46 user devstack@n-api.service[61308]: DEBUG dbcounter [-] [61308] Writing DB stats nova_cell0:SELECT=6 {{(pid=61308) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:56:46 user devstack@n-api.service[61308]: DEBUG dbcounter [-] [61308] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=3 {{(pid=61308) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:56:46 user devstack@n-api.service[61308]: DEBUG dbcounter [-] [61308] Writing DB stats nova_cell1:SELECT=4 {{(pid=61308) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:56:46 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi [None req-0568c443-035d-4e4b-93bc-64887f5534b4 tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Calling method '>' {{(pid=61308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 03:56:46 user devstack@n-api.service[61308]: DEBUG nova.compute.api [None req-0568c443-035d-4e4b-93bc-64887f5534b4 tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] [instance: a3378117-215b-457c-b9ba-5099c5810e4d] Fetching instance by UUID {{(pid=61308) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 23 03:56:47 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-0568c443-035d-4e4b-93bc-64887f5534b4 tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:56:47 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-0568c443-035d-4e4b-93bc-64887f5534b4 tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:56:47 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-0568c443-035d-4e4b-93bc-64887f5534b4 tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:56:47 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-0568c443-035d-4e4b-93bc-64887f5534b4 tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:56:47 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-0568c443-035d-4e4b-93bc-64887f5534b4 tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:56:47 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-0568c443-035d-4e4b-93bc-64887f5534b4 tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:56:47 user devstack@n-api.service[61308]: DEBUG nova.compute.api [None req-0568c443-035d-4e4b-93bc-64887f5534b4 tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] [instance: a3378117-215b-457c-b9ba-5099c5810e4d] Going to try to terminate instance {{(pid=61308) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 23 03:56:47 user devstack@n-api.service[61308]: DEBUG nova.compute.api [None req-0568c443-035d-4e4b-93bc-64887f5534b4 tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] [instance: a3378117-215b-457c-b9ba-5099c5810e4d] Doing local delete in cell d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb(cell1) {{(pid=61308) _delete /opt/stack/nova/nova/compute/api.py:2546}} Apr 23 03:56:47 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-0568c443-035d-4e4b-93bc-64887f5534b4 tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:56:47 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-0568c443-035d-4e4b-93bc-64887f5534b4 tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:56:47 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-0568c443-035d-4e4b-93bc-64887f5534b4 tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:56:47 user devstack@n-api.service[61308]: WARNING nova.compute.api [None req-0568c443-035d-4e4b-93bc-64887f5534b4 tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] [instance: a3378117-215b-457c-b9ba-5099c5810e4d] instance's host None is down, deleting from database Apr 23 03:56:47 user devstack@n-api.service[61308]: DEBUG nova.network.neutron [None req-0568c443-035d-4e4b-93bc-64887f5534b4 tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] [instance: a3378117-215b-457c-b9ba-5099c5810e4d] deallocate_for_instance() {{(pid=61308) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}} Apr 23 03:56:47 user devstack@n-api.service[61308]: DEBUG nova.network.neutron [None req-0568c443-035d-4e4b-93bc-64887f5534b4 tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] [instance: a3378117-215b-457c-b9ba-5099c5810e4d] Instance cache missing network info. {{(pid=61308) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}} Apr 23 03:56:47 user devstack@n-api.service[61308]: DEBUG nova.network.neutron [None req-0568c443-035d-4e4b-93bc-64887f5534b4 tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] [instance: a3378117-215b-457c-b9ba-5099c5810e4d] Updating instance_info_cache with network_info: [] {{(pid=61308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Apr 23 03:56:47 user devstack@n-api.service[61308]: DEBUG nova.compute.api [None req-0568c443-035d-4e4b-93bc-64887f5534b4 tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] [instance: a3378117-215b-457c-b9ba-5099c5810e4d] Unable to find connector for volume None, not attempting terminate_connection. {{(pid=61308) _local_cleanup_bdm_volumes /opt/stack/nova/nova/compute/api.py:2612}} Apr 23 03:56:47 user devstack@n-api.service[61308]: WARNING nova.compute.api [None req-0568c443-035d-4e4b-93bc-64887f5534b4 tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] [instance: a3378117-215b-457c-b9ba-5099c5810e4d] Ignoring volume cleanup failure due to Volume None could not be found.: nova.exception.VolumeNotFound: Volume None could not be found. Apr 23 03:56:47 user devstack@n-api.service[61308]: INFO nova.api.openstack.requestlog [None req-0568c443-035d-4e4b-93bc-64887f5534b4 tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a3378117-215b-457c-b9ba-5099c5810e4d" status: 204 len: 0 microversion: 2.87 time: 0.531838 Apr 23 03:56:47 user devstack@n-api.service[61308]: [pid: 61308|app: 0|req: 118/346] 10.0.0.210 () {64 vars in 1357 bytes} [Sun Apr 23 03:56:46 2023] DELETE /compute/v2.1/servers/a3378117-215b-457c-b9ba-5099c5810e4d => generated 0 bytes in 534 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 23 03:56:47 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi [None req-dae47e1c-f5f5-4a49-8924-abad615952bd tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Calling method '>' {{(pid=61306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 03:56:47 user devstack@n-api.service[61306]: DEBUG nova.compute.api [None req-dae47e1c-f5f5-4a49-8924-abad615952bd tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] [instance: a3378117-215b-457c-b9ba-5099c5810e4d] Fetching instance by UUID {{(pid=61306) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 23 03:56:47 user devstack@n-api.service[61306]: DEBUG dbcounter [-] [61306] Writing DB stats nova_cell0:SELECT=2 {{(pid=61306) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:56:47 user devstack@n-api.service[61306]: DEBUG dbcounter [-] [61306] Writing DB stats nova_api:SELECT=6 {{(pid=61306) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:56:47 user devstack@n-api.service[61306]: DEBUG dbcounter [-] [61306] Writing DB stats nova_cell1:SELECT=2 {{(pid=61306) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:56:47 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-dae47e1c-f5f5-4a49-8924-abad615952bd tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:56:47 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-dae47e1c-f5f5-4a49-8924-abad615952bd tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:56:47 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-dae47e1c-f5f5-4a49-8924-abad615952bd tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:56:47 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-dae47e1c-f5f5-4a49-8924-abad615952bd tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:56:47 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-dae47e1c-f5f5-4a49-8924-abad615952bd tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:56:47 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-dae47e1c-f5f5-4a49-8924-abad615952bd tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:56:47 user devstack@n-api.service[61306]: INFO nova.api.openstack.wsgi [None req-dae47e1c-f5f5-4a49-8924-abad615952bd tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] HTTP exception thrown: Instance a3378117-215b-457c-b9ba-5099c5810e4d could not be found. Apr 23 03:56:47 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi [None req-dae47e1c-f5f5-4a49-8924-abad615952bd tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Request method failure captured: Apr 23 03:56:47 user devstack@n-api.service[61306]: request: GET /compute/v2.1/servers/a3378117-215b-457c-b9ba-5099c5810e4d HTTP/1.1 Apr 23 03:56:47 user devstack@n-api.service[61306]: Accept: application/json Apr 23 03:56:47 user devstack@n-api.service[61306]: Accept-Encoding: identity Apr 23 03:56:47 user devstack@n-api.service[61306]: Connection: close Apr 23 03:56:47 user devstack@n-api.service[61306]: Content-Length: 0 Apr 23 03:56:47 user devstack@n-api.service[61306]: Content-Type: application/json Apr 23 03:56:47 user devstack@n-api.service[61306]: Host: 10.0.0.210 Apr 23 03:56:47 user devstack@n-api.service[61306]: Openstack-System-Scope: None Apr 23 03:56:47 user devstack@n-api.service[61306]: User-Agent: python-urllib3/1.26.15 Apr 23 03:56:47 user devstack@n-api.service[61306]: X-Auth-Token: gAAAAABkRKqymTVo46ELxd1uSw-EAoRR5lujatiDr7IMoAhu4i8DKWULtOBBybCOSHvaEwkXcd5s0zATq7gbIXqGH0um8sKXUKLCZOTVf0WZe1CrOig4R-b1xOF2MgBI4Lr-InRHxovj2jR4wzIZeUUz6B2eBSbR5fbWI_3Fzi1ZiHFHIpTIGPE Apr 23 03:56:47 user devstack@n-api.service[61306]: X-Domain-Id: None Apr 23 03:56:47 user devstack@n-api.service[61306]: X-Domain-Name: None Apr 23 03:56:47 user devstack@n-api.service[61306]: X-Identity-Status: Confirmed Apr 23 03:56:47 user devstack@n-api.service[61306]: X-Is-Admin-Project: True Apr 23 03:56:47 user devstack@n-api.service[61306]: X-Openstack-Nova-Api-Version: 2.87 Apr 23 03:56:47 user devstack@n-api.service[61306]: X-Project-Domain-Id: default Apr 23 03:56:47 user devstack@n-api.service[61306]: X-Project-Domain-Name: Default Apr 23 03:56:47 user devstack@n-api.service[61306]: X-Project-Id: a79e09b1c4ae4cc5ab11c3e56ee4f0d9 Apr 23 03:56:47 user devstack@n-api.service[61306]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-653032906 Apr 23 03:56:47 user devstack@n-api.service[61306]: X-Role: reader,member Apr 23 03:56:47 user devstack@n-api.service[61306]: X-Roles: reader,member Apr 23 03:56:47 user devstack@n-api.service[61306]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a79e09b1c4ae4cc5ab11c3e56ee4f0d9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a79e09b1c4ae4cc5ab11c3e56ee4f0d9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a79e09b1c4ae4cc5ab11c3e56ee4f0d9"}]}] Apr 23 03:56:47 user devstack@n-api.service[61306]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-653032906 Apr 23 03:56:47 user devstack@n-api.service[61306]: X-Tenant-Id: a79e09b1c4ae4cc5ab11c3e56ee4f0d9 Apr 23 03:56:47 user devstack@n-api.service[61306]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-653032906 Apr 23 03:56:47 user devstack@n-api.service[61306]: X-User: tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member Apr 23 03:56:47 user devstack@n-api.service[61306]: X-User-Domain-Id: default Apr 23 03:56:47 user devstack@n-api.service[61306]: X-User-Domain-Name: Default Apr 23 03:56:47 user devstack@n-api.service[61306]: X-User-Id: 99495726467944c38620831fc93e2856 Apr 23 03:56:47 user devstack@n-api.service[61306]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member Apr 23 03:56:47 user devstack@n-api.service[61306]: method: > Apr 23 03:56:47 user devstack@n-api.service[61306]: exception: Instance a3378117-215b-457c-b9ba-5099c5810e4d could not be found. Apr 23 03:56:47 user devstack@n-api.service[61306]: action_args: {'id': 'a3378117-215b-457c-b9ba-5099c5810e4d'} Apr 23 03:56:47 user devstack@n-api.service[61306]: {{(pid=61306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 23 03:56:47 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 23 03:56:47 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 23 03:56:47 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 23 03:56:47 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 23 03:56:47 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 23 03:56:47 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 23 03:56:47 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 23 03:56:47 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 23 03:56:47 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 23 03:56:47 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3378117-215b-457c-b9ba-5099c5810e4d could not be found. Apr 23 03:56:47 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi Apr 23 03:56:47 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 23 03:56:47 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi Apr 23 03:56:47 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 23 03:56:47 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 23 03:56:47 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 23 03:56:47 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 23 03:56:47 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 23 03:56:47 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 23 03:56:47 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 23 03:56:47 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 23 03:56:47 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 23 03:56:47 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 23 03:56:47 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 23 03:56:47 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 23 03:56:47 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 23 03:56:47 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3378117-215b-457c-b9ba-5099c5810e4d could not be found. Apr 23 03:56:47 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi Apr 23 03:56:47 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 23 03:56:47 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi Apr 23 03:56:47 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 23 03:56:47 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 23 03:56:47 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 23 03:56:47 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 23 03:56:47 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 23 03:56:47 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3378117-215b-457c-b9ba-5099c5810e4d could not be found. Apr 23 03:56:47 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi Apr 23 03:56:47 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi [None req-dae47e1c-f5f5-4a49-8924-abad615952bd tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Returning 404 to user: Instance a3378117-215b-457c-b9ba-5099c5810e4d could not be found. {{(pid=61306) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 23 03:56:47 user devstack@n-api.service[61306]: INFO nova.api.openstack.requestlog [None req-dae47e1c-f5f5-4a49-8924-abad615952bd tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a3378117-215b-457c-b9ba-5099c5810e4d" status: 404 len: 111 microversion: 2.87 time: 0.036834 Apr 23 03:56:47 user devstack@n-api.service[61306]: [pid: 61306|app: 0|req: 114/347] 10.0.0.210 () {64 vars in 1354 bytes} [Sun Apr 23 03:56:47 2023] GET /compute/v2.1/servers/a3378117-215b-457c-b9ba-5099c5810e4d => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 23 03:56:47 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi [None req-f72aa7bc-9edd-4cc4-9f97-c0e637f39a9f tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Calling method '>' {{(pid=61307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 03:56:47 user devstack@n-api.service[61307]: DEBUG nova.compute.api [None req-f72aa7bc-9edd-4cc4-9f97-c0e637f39a9f tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] [instance: 97b28eb9-634c-4f9b-97ef-41d9f45f19b7] Fetching instance by UUID {{(pid=61307) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 23 03:56:47 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-f72aa7bc-9edd-4cc4-9f97-c0e637f39a9f tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:56:47 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-f72aa7bc-9edd-4cc4-9f97-c0e637f39a9f tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:56:47 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-f72aa7bc-9edd-4cc4-9f97-c0e637f39a9f tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:56:47 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-f72aa7bc-9edd-4cc4-9f97-c0e637f39a9f tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:56:47 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-f72aa7bc-9edd-4cc4-9f97-c0e637f39a9f tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:56:47 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-f72aa7bc-9edd-4cc4-9f97-c0e637f39a9f tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:56:47 user devstack@n-api.service[61307]: DEBUG nova.compute.api [None req-f72aa7bc-9edd-4cc4-9f97-c0e637f39a9f tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] [instance: 97b28eb9-634c-4f9b-97ef-41d9f45f19b7] Going to try to terminate instance {{(pid=61307) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 23 03:56:47 user devstack@n-api.service[61307]: INFO nova.api.openstack.requestlog [None req-f72aa7bc-9edd-4cc4-9f97-c0e637f39a9f tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/97b28eb9-634c-4f9b-97ef-41d9f45f19b7" status: 204 len: 0 microversion: 2.87 time: 0.113350 Apr 23 03:56:47 user devstack@n-api.service[61307]: [pid: 61307|app: 0|req: 116/348] 10.0.0.210 () {64 vars in 1357 bytes} [Sun Apr 23 03:56:47 2023] DELETE /compute/v2.1/servers/97b28eb9-634c-4f9b-97ef-41d9f45f19b7 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 23 03:56:47 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi [None req-cb58d3da-3b14-4952-acb5-a0e0905794d8 tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Calling method '>' {{(pid=61308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 03:56:47 user devstack@n-api.service[61308]: DEBUG nova.compute.api [None req-cb58d3da-3b14-4952-acb5-a0e0905794d8 tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] [instance: 97b28eb9-634c-4f9b-97ef-41d9f45f19b7] Fetching instance by UUID {{(pid=61308) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 23 03:56:47 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-cb58d3da-3b14-4952-acb5-a0e0905794d8 tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:56:47 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-cb58d3da-3b14-4952-acb5-a0e0905794d8 tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:56:47 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-cb58d3da-3b14-4952-acb5-a0e0905794d8 tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:56:47 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-cb58d3da-3b14-4952-acb5-a0e0905794d8 tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:56:47 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-cb58d3da-3b14-4952-acb5-a0e0905794d8 tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:56:47 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-cb58d3da-3b14-4952-acb5-a0e0905794d8 tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:56:48 user devstack@n-api.service[61308]: DEBUG nova.policy [None req-cb58d3da-3b14-4952-acb5-a0e0905794d8 tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99495726467944c38620831fc93e2856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79e09b1c4ae4cc5ab11c3e56ee4f0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61308) authorize /opt/stack/nova/nova/policy.py:203}} Apr 23 03:56:48 user devstack@n-api.service[61308]: DEBUG nova.policy [None req-cb58d3da-3b14-4952-acb5-a0e0905794d8 tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99495726467944c38620831fc93e2856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79e09b1c4ae4cc5ab11c3e56ee4f0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61308) authorize /opt/stack/nova/nova/policy.py:203}} Apr 23 03:56:48 user devstack@n-api.service[61308]: DEBUG nova.policy [None req-cb58d3da-3b14-4952-acb5-a0e0905794d8 tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99495726467944c38620831fc93e2856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79e09b1c4ae4cc5ab11c3e56ee4f0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61308) authorize /opt/stack/nova/nova/policy.py:203}} Apr 23 03:56:48 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi [req-90414942-330a-4887-83a7-371b3365b384 req-405f464b-1772-4dc0-9f5d-7e661b85f08a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97b28eb9-634c-4f9b-97ef-41d9f45f19b7", "name": "network-vif-unplugged", "status": "completed", "tag": "6d65b2b7-2a9a-4e2b-b003-af767e8a544f"}]} {{(pid=61306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 03:56:48 user devstack@n-api.service[61308]: INFO nova.api.openstack.requestlog [None req-cb58d3da-3b14-4952-acb5-a0e0905794d8 tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] 10.0.0.210 "GET /compute/v2.1/servers/97b28eb9-634c-4f9b-97ef-41d9f45f19b7" status: 200 len: 1697 microversion: 2.87 time: 0.363079 Apr 23 03:56:48 user devstack@n-api.service[61308]: [pid: 61308|app: 0|req: 119/349] 10.0.0.210 () {64 vars in 1354 bytes} [Sun Apr 23 03:56:47 2023] GET /compute/v2.1/servers/97b28eb9-634c-4f9b-97ef-41d9f45f19b7 => generated 1697 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 23 03:56:48 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [req-90414942-330a-4887-83a7-371b3365b384 req-405f464b-1772-4dc0-9f5d-7e661b85f08a service nova] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:56:48 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [req-90414942-330a-4887-83a7-371b3365b384 req-405f464b-1772-4dc0-9f5d-7e661b85f08a service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:56:48 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [req-90414942-330a-4887-83a7-371b3365b384 req-405f464b-1772-4dc0-9f5d-7e661b85f08a service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:56:48 user devstack@n-api.service[61306]: INFO nova.api.openstack.compute.server_external_events [req-90414942-330a-4887-83a7-371b3365b384 req-405f464b-1772-4dc0-9f5d-7e661b85f08a service nova] Creating event network-vif-unplugged:6d65b2b7-2a9a-4e2b-b003-af767e8a544f for instance 97b28eb9-634c-4f9b-97ef-41d9f45f19b7 on user Apr 23 03:56:48 user devstack@n-api.service[61306]: INFO nova.api.openstack.requestlog [req-90414942-330a-4887-83a7-371b3365b384 req-405f464b-1772-4dc0-9f5d-7e661b85f08a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.028929 Apr 23 03:56:48 user devstack@n-api.service[61306]: [pid: 61306|app: 0|req: 115/350] 10.0.0.210 () {68 vars in 1394 bytes} [Sun Apr 23 03:56:48 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 23 03:56:49 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi [req-79cac052-23db-4f23-9a35-a5ca1b1f7830 req-c117cb53-89f4-4be8-a2d8-f778888025d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97b28eb9-634c-4f9b-97ef-41d9f45f19b7", "name": "network-vif-deleted", "tag": "6d65b2b7-2a9a-4e2b-b003-af767e8a544f"}]} {{(pid=61307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 03:56:49 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [req-79cac052-23db-4f23-9a35-a5ca1b1f7830 req-c117cb53-89f4-4be8-a2d8-f778888025d0 service nova] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:56:49 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [req-79cac052-23db-4f23-9a35-a5ca1b1f7830 req-c117cb53-89f4-4be8-a2d8-f778888025d0 service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:56:49 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [req-79cac052-23db-4f23-9a35-a5ca1b1f7830 req-c117cb53-89f4-4be8-a2d8-f778888025d0 service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:56:49 user devstack@n-api.service[61307]: INFO nova.api.openstack.compute.server_external_events [req-79cac052-23db-4f23-9a35-a5ca1b1f7830 req-c117cb53-89f4-4be8-a2d8-f778888025d0 service nova] Creating event network-vif-deleted:6d65b2b7-2a9a-4e2b-b003-af767e8a544f for instance 97b28eb9-634c-4f9b-97ef-41d9f45f19b7 on user Apr 23 03:56:49 user devstack@n-api.service[61307]: INFO nova.api.openstack.requestlog [req-79cac052-23db-4f23-9a35-a5ca1b1f7830 req-c117cb53-89f4-4be8-a2d8-f778888025d0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034746 Apr 23 03:56:49 user devstack@n-api.service[61307]: [pid: 61307|app: 0|req: 117/351] 10.0.0.210 () {68 vars in 1394 bytes} [Sun Apr 23 03:56:49 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 23 03:56:50 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi [req-bcf7cae6-2252-414e-bbba-0434a4b7fc32 req-49f90395-4ff5-4ec1-98bf-ca7c3349ce0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97b28eb9-634c-4f9b-97ef-41d9f45f19b7", "name": "network-vif-plugged", "status": "completed", "tag": "6d65b2b7-2a9a-4e2b-b003-af767e8a544f"}]} {{(pid=61308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 03:56:50 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [req-bcf7cae6-2252-414e-bbba-0434a4b7fc32 req-49f90395-4ff5-4ec1-98bf-ca7c3349ce0f service nova] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:56:50 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [req-bcf7cae6-2252-414e-bbba-0434a4b7fc32 req-49f90395-4ff5-4ec1-98bf-ca7c3349ce0f service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:56:50 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [req-bcf7cae6-2252-414e-bbba-0434a4b7fc32 req-49f90395-4ff5-4ec1-98bf-ca7c3349ce0f service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:56:50 user devstack@n-api.service[61308]: INFO nova.api.openstack.compute.server_external_events [req-bcf7cae6-2252-414e-bbba-0434a4b7fc32 req-49f90395-4ff5-4ec1-98bf-ca7c3349ce0f service nova] Creating event network-vif-plugged:6d65b2b7-2a9a-4e2b-b003-af767e8a544f for instance 97b28eb9-634c-4f9b-97ef-41d9f45f19b7 on user Apr 23 03:56:50 user devstack@n-api.service[61308]: INFO nova.api.openstack.requestlog [req-bcf7cae6-2252-414e-bbba-0434a4b7fc32 req-49f90395-4ff5-4ec1-98bf-ca7c3349ce0f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028523 Apr 23 03:56:50 user devstack@n-api.service[61308]: [pid: 61308|app: 0|req: 120/352] 10.0.0.210 () {68 vars in 1394 bytes} [Sun Apr 23 03:56:50 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 23 03:57:10 user devstack@n-api.service[61306]: DEBUG dbcounter [-] [61306] Writing DB stats nova_api:SELECT=4 {{(pid=61306) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:57:10 user devstack@n-api.service[61306]: DEBUG dbcounter [-] [61306] Writing DB stats nova_cell1:SELECT=4 {{(pid=61306) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:57:10 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi [None req-fa617504-3bad-4a82-ba82-edfbe2f7230e tempest-ServersNegativeTestJSON-1115615559 tempest-ServersNegativeTestJSON-1115615559-project-member] Calling method '>' {{(pid=61306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 03:57:10 user devstack@n-api.service[61306]: DEBUG nova.compute.api [None req-fa617504-3bad-4a82-ba82-edfbe2f7230e tempest-ServersNegativeTestJSON-1115615559 tempest-ServersNegativeTestJSON-1115615559-project-member] [instance: ee89a9d5-0507-475c-bea2-e02e34d15710] Fetching instance by UUID {{(pid=61306) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 23 03:57:10 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-fa617504-3bad-4a82-ba82-edfbe2f7230e tempest-ServersNegativeTestJSON-1115615559 tempest-ServersNegativeTestJSON-1115615559-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:57:10 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-fa617504-3bad-4a82-ba82-edfbe2f7230e tempest-ServersNegativeTestJSON-1115615559 tempest-ServersNegativeTestJSON-1115615559-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:57:10 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-fa617504-3bad-4a82-ba82-edfbe2f7230e tempest-ServersNegativeTestJSON-1115615559 tempest-ServersNegativeTestJSON-1115615559-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:57:10 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-fa617504-3bad-4a82-ba82-edfbe2f7230e tempest-ServersNegativeTestJSON-1115615559 tempest-ServersNegativeTestJSON-1115615559-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:57:10 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-fa617504-3bad-4a82-ba82-edfbe2f7230e tempest-ServersNegativeTestJSON-1115615559 tempest-ServersNegativeTestJSON-1115615559-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:57:10 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-fa617504-3bad-4a82-ba82-edfbe2f7230e tempest-ServersNegativeTestJSON-1115615559 tempest-ServersNegativeTestJSON-1115615559-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:57:10 user devstack@n-api.service[61306]: DEBUG nova.policy [None req-fa617504-3bad-4a82-ba82-edfbe2f7230e tempest-ServersNegativeTestJSON-1115615559 tempest-ServersNegativeTestJSON-1115615559-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d9ae4a3b00492fa2fc16a22a34df09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39d6cb4cfcb2413f8039ee9febf1c046', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61306) authorize /opt/stack/nova/nova/policy.py:203}} Apr 23 03:57:10 user devstack@n-api.service[61306]: INFO nova.api.openstack.requestlog [None req-fa617504-3bad-4a82-ba82-edfbe2f7230e tempest-ServersNegativeTestJSON-1115615559 tempest-ServersNegativeTestJSON-1115615559-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ee89a9d5-0507-475c-bea2-e02e34d15710" status: 200 len: 1495 microversion: 2.1 time: 0.239269 Apr 23 03:57:10 user devstack@n-api.service[61306]: [pid: 61306|app: 0|req: 116/353] 10.0.0.210 () {62 vars in 1313 bytes} [Sun Apr 23 03:57:10 2023] GET /compute/v2.1/servers/ee89a9d5-0507-475c-bea2-e02e34d15710 => generated 1495 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 23 03:57:38 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi [None req-1375487c-9eba-4646-a68b-b64300fc6317 tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Calling method '>' {{(pid=61307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 03:57:38 user devstack@n-api.service[61307]: DEBUG nova.compute.api [None req-1375487c-9eba-4646-a68b-b64300fc6317 tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] [instance: 97b28eb9-634c-4f9b-97ef-41d9f45f19b7] Fetching instance by UUID {{(pid=61307) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 23 03:57:38 user devstack@n-api.service[61307]: DEBUG dbcounter [-] [61307] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=61307) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:57:38 user devstack@n-api.service[61307]: DEBUG dbcounter [-] [61307] Writing DB stats nova_cell1:SELECT=25,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61307) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:57:38 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-1375487c-9eba-4646-a68b-b64300fc6317 tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:57:38 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-1375487c-9eba-4646-a68b-b64300fc6317 tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:57:38 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-1375487c-9eba-4646-a68b-b64300fc6317 tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:57:38 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-1375487c-9eba-4646-a68b-b64300fc6317 tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:57:38 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-1375487c-9eba-4646-a68b-b64300fc6317 tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:57:38 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-1375487c-9eba-4646-a68b-b64300fc6317 tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:57:38 user devstack@n-api.service[61307]: INFO nova.api.openstack.wsgi [None req-1375487c-9eba-4646-a68b-b64300fc6317 tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] HTTP exception thrown: Instance 97b28eb9-634c-4f9b-97ef-41d9f45f19b7 could not be found. Apr 23 03:57:38 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi [None req-1375487c-9eba-4646-a68b-b64300fc6317 tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Request method failure captured: Apr 23 03:57:38 user devstack@n-api.service[61307]: request: GET /compute/v2.1/servers/97b28eb9-634c-4f9b-97ef-41d9f45f19b7 HTTP/1.1 Apr 23 03:57:38 user devstack@n-api.service[61307]: Accept: application/json Apr 23 03:57:38 user devstack@n-api.service[61307]: Accept-Encoding: identity Apr 23 03:57:38 user devstack@n-api.service[61307]: Connection: close Apr 23 03:57:38 user devstack@n-api.service[61307]: Content-Length: 0 Apr 23 03:57:38 user devstack@n-api.service[61307]: Content-Type: application/json Apr 23 03:57:38 user devstack@n-api.service[61307]: Host: 10.0.0.210 Apr 23 03:57:38 user devstack@n-api.service[61307]: Openstack-System-Scope: None Apr 23 03:57:38 user devstack@n-api.service[61307]: User-Agent: python-urllib3/1.26.15 Apr 23 03:57:38 user devstack@n-api.service[61307]: X-Auth-Token: gAAAAABkRKqymTVo46ELxd1uSw-EAoRR5lujatiDr7IMoAhu4i8DKWULtOBBybCOSHvaEwkXcd5s0zATq7gbIXqGH0um8sKXUKLCZOTVf0WZe1CrOig4R-b1xOF2MgBI4Lr-InRHxovj2jR4wzIZeUUz6B2eBSbR5fbWI_3Fzi1ZiHFHIpTIGPE Apr 23 03:57:38 user devstack@n-api.service[61307]: X-Domain-Id: None Apr 23 03:57:38 user devstack@n-api.service[61307]: X-Domain-Name: None Apr 23 03:57:38 user devstack@n-api.service[61307]: X-Identity-Status: Confirmed Apr 23 03:57:38 user devstack@n-api.service[61307]: X-Is-Admin-Project: True Apr 23 03:57:38 user devstack@n-api.service[61307]: X-Openstack-Nova-Api-Version: 2.87 Apr 23 03:57:38 user devstack@n-api.service[61307]: X-Project-Domain-Id: default Apr 23 03:57:38 user devstack@n-api.service[61307]: X-Project-Domain-Name: Default Apr 23 03:57:38 user devstack@n-api.service[61307]: X-Project-Id: a79e09b1c4ae4cc5ab11c3e56ee4f0d9 Apr 23 03:57:38 user devstack@n-api.service[61307]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-653032906 Apr 23 03:57:38 user devstack@n-api.service[61307]: X-Role: reader,member Apr 23 03:57:38 user devstack@n-api.service[61307]: X-Roles: reader,member Apr 23 03:57:38 user devstack@n-api.service[61307]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a79e09b1c4ae4cc5ab11c3e56ee4f0d9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a79e09b1c4ae4cc5ab11c3e56ee4f0d9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a79e09b1c4ae4cc5ab11c3e56ee4f0d9"}]}] Apr 23 03:57:38 user devstack@n-api.service[61307]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-653032906 Apr 23 03:57:38 user devstack@n-api.service[61307]: X-Tenant-Id: a79e09b1c4ae4cc5ab11c3e56ee4f0d9 Apr 23 03:57:38 user devstack@n-api.service[61307]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-653032906 Apr 23 03:57:38 user devstack@n-api.service[61307]: X-User: tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member Apr 23 03:57:38 user devstack@n-api.service[61307]: X-User-Domain-Id: default Apr 23 03:57:38 user devstack@n-api.service[61307]: X-User-Domain-Name: Default Apr 23 03:57:38 user devstack@n-api.service[61307]: X-User-Id: 99495726467944c38620831fc93e2856 Apr 23 03:57:38 user devstack@n-api.service[61307]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member Apr 23 03:57:38 user devstack@n-api.service[61307]: method: > Apr 23 03:57:38 user devstack@n-api.service[61307]: exception: Instance 97b28eb9-634c-4f9b-97ef-41d9f45f19b7 could not be found. Apr 23 03:57:38 user devstack@n-api.service[61307]: action_args: {'id': '97b28eb9-634c-4f9b-97ef-41d9f45f19b7'} Apr 23 03:57:38 user devstack@n-api.service[61307]: {{(pid=61307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 23 03:57:38 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 23 03:57:38 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 23 03:57:38 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 23 03:57:38 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 23 03:57:38 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 23 03:57:38 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 23 03:57:38 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 23 03:57:38 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 23 03:57:38 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 23 03:57:38 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97b28eb9-634c-4f9b-97ef-41d9f45f19b7 could not be found. Apr 23 03:57:38 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi Apr 23 03:57:38 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 23 03:57:38 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi Apr 23 03:57:38 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 23 03:57:38 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 23 03:57:38 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 23 03:57:38 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 23 03:57:38 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 23 03:57:38 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 23 03:57:38 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 23 03:57:38 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 23 03:57:38 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 23 03:57:38 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 23 03:57:38 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 23 03:57:38 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 23 03:57:38 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 23 03:57:38 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97b28eb9-634c-4f9b-97ef-41d9f45f19b7 could not be found. Apr 23 03:57:38 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi Apr 23 03:57:38 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 23 03:57:38 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi Apr 23 03:57:38 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 23 03:57:38 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 23 03:57:38 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 23 03:57:38 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 23 03:57:38 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 23 03:57:38 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97b28eb9-634c-4f9b-97ef-41d9f45f19b7 could not be found. Apr 23 03:57:38 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi Apr 23 03:57:38 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi [None req-1375487c-9eba-4646-a68b-b64300fc6317 tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Returning 404 to user: Instance 97b28eb9-634c-4f9b-97ef-41d9f45f19b7 could not be found. {{(pid=61307) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 23 03:57:38 user devstack@n-api.service[61307]: INFO nova.api.openstack.requestlog [None req-1375487c-9eba-4646-a68b-b64300fc6317 tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] 10.0.0.210 "GET /compute/v2.1/servers/97b28eb9-634c-4f9b-97ef-41d9f45f19b7" status: 404 len: 111 microversion: 2.87 time: 0.042110 Apr 23 03:57:38 user devstack@n-api.service[61307]: [pid: 61307|app: 0|req: 118/354] 10.0.0.210 () {64 vars in 1354 bytes} [Sun Apr 23 03:57:38 2023] GET /compute/v2.1/servers/97b28eb9-634c-4f9b-97ef-41d9f45f19b7 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 23 03:57:38 user devstack@n-api.service[61308]: DEBUG dbcounter [-] [61308] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=61308) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:57:38 user devstack@n-api.service[61308]: DEBUG dbcounter [-] [61308] Writing DB stats nova_cell1:SELECT=35,nova_cell1:UPDATE=17,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2,nova_cell1:INSERT=1 {{(pid=61308) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:57:38 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi [None req-24658ab6-ae82-4e9b-a232-cca990f99445 tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Calling method '>' {{(pid=61308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 03:57:38 user devstack@n-api.service[61308]: DEBUG nova.compute.api [None req-24658ab6-ae82-4e9b-a232-cca990f99445 tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] [instance: c8480a7c-b5de-4f66-a4f0-08fc679b0dfd] Fetching instance by UUID {{(pid=61308) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 23 03:57:38 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-24658ab6-ae82-4e9b-a232-cca990f99445 tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:57:38 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-24658ab6-ae82-4e9b-a232-cca990f99445 tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:57:38 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-24658ab6-ae82-4e9b-a232-cca990f99445 tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:57:38 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-24658ab6-ae82-4e9b-a232-cca990f99445 tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:57:38 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-24658ab6-ae82-4e9b-a232-cca990f99445 tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:57:38 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-24658ab6-ae82-4e9b-a232-cca990f99445 tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:57:38 user devstack@n-api.service[61308]: DEBUG nova.compute.api [None req-24658ab6-ae82-4e9b-a232-cca990f99445 tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] [instance: c8480a7c-b5de-4f66-a4f0-08fc679b0dfd] Going to try to terminate instance {{(pid=61308) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 23 03:57:38 user devstack@n-api.service[61308]: INFO nova.api.openstack.requestlog [None req-24658ab6-ae82-4e9b-a232-cca990f99445 tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/c8480a7c-b5de-4f66-a4f0-08fc679b0dfd" status: 204 len: 0 microversion: 2.87 time: 0.124693 Apr 23 03:57:38 user devstack@n-api.service[61308]: [pid: 61308|app: 0|req: 121/355] 10.0.0.210 () {64 vars in 1357 bytes} [Sun Apr 23 03:57:38 2023] DELETE /compute/v2.1/servers/c8480a7c-b5de-4f66-a4f0-08fc679b0dfd => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 23 03:57:38 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi [None req-3735480a-abda-42e6-af21-c3d29f0dc4a8 tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Calling method '>' {{(pid=61306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 03:57:38 user devstack@n-api.service[61306]: DEBUG nova.compute.api [None req-3735480a-abda-42e6-af21-c3d29f0dc4a8 tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] [instance: c8480a7c-b5de-4f66-a4f0-08fc679b0dfd] Fetching instance by UUID {{(pid=61306) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 23 03:57:38 user devstack@n-api.service[61306]: DEBUG dbcounter [-] [61306] Writing DB stats nova_api:SELECT=2 {{(pid=61306) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:57:38 user devstack@n-api.service[61306]: DEBUG dbcounter [-] [61306] Writing DB stats nova_cell1:SELECT=6 {{(pid=61306) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:57:38 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-3735480a-abda-42e6-af21-c3d29f0dc4a8 tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:57:38 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-3735480a-abda-42e6-af21-c3d29f0dc4a8 tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:57:38 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-3735480a-abda-42e6-af21-c3d29f0dc4a8 tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:57:38 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-3735480a-abda-42e6-af21-c3d29f0dc4a8 tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:57:38 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-3735480a-abda-42e6-af21-c3d29f0dc4a8 tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:57:38 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-3735480a-abda-42e6-af21-c3d29f0dc4a8 tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:57:39 user devstack@n-api.service[61306]: DEBUG nova.policy [None req-3735480a-abda-42e6-af21-c3d29f0dc4a8 tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99495726467944c38620831fc93e2856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79e09b1c4ae4cc5ab11c3e56ee4f0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61306) authorize /opt/stack/nova/nova/policy.py:203}} Apr 23 03:57:39 user devstack@n-api.service[61306]: DEBUG nova.policy [None req-3735480a-abda-42e6-af21-c3d29f0dc4a8 tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99495726467944c38620831fc93e2856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79e09b1c4ae4cc5ab11c3e56ee4f0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61306) authorize /opt/stack/nova/nova/policy.py:203}} Apr 23 03:57:39 user devstack@n-api.service[61306]: DEBUG nova.policy [None req-3735480a-abda-42e6-af21-c3d29f0dc4a8 tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99495726467944c38620831fc93e2856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79e09b1c4ae4cc5ab11c3e56ee4f0d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61306) authorize /opt/stack/nova/nova/policy.py:203}} Apr 23 03:57:39 user devstack@n-api.service[61306]: INFO nova.api.openstack.requestlog [None req-3735480a-abda-42e6-af21-c3d29f0dc4a8 tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c8480a7c-b5de-4f66-a4f0-08fc679b0dfd" status: 200 len: 1697 microversion: 2.87 time: 0.320166 Apr 23 03:57:39 user devstack@n-api.service[61306]: [pid: 61306|app: 0|req: 117/356] 10.0.0.210 () {64 vars in 1354 bytes} [Sun Apr 23 03:57:38 2023] GET /compute/v2.1/servers/c8480a7c-b5de-4f66-a4f0-08fc679b0dfd => generated 1697 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 23 03:57:39 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi [req-196ab89b-66af-4b75-9818-25e02b57f19b req-f042bc7b-5255-4b45-aa71-6f86392b6979 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8480a7c-b5de-4f66-a4f0-08fc679b0dfd", "name": "network-vif-unplugged", "status": "completed", "tag": "e7548d21-c865-4648-a8a6-dba748a01e14"}]} {{(pid=61307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 03:57:39 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [req-196ab89b-66af-4b75-9818-25e02b57f19b req-f042bc7b-5255-4b45-aa71-6f86392b6979 service nova] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:57:39 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [req-196ab89b-66af-4b75-9818-25e02b57f19b req-f042bc7b-5255-4b45-aa71-6f86392b6979 service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:57:39 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [req-196ab89b-66af-4b75-9818-25e02b57f19b req-f042bc7b-5255-4b45-aa71-6f86392b6979 service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:57:39 user devstack@n-api.service[61307]: INFO nova.api.openstack.compute.server_external_events [req-196ab89b-66af-4b75-9818-25e02b57f19b req-f042bc7b-5255-4b45-aa71-6f86392b6979 service nova] Creating event network-vif-unplugged:e7548d21-c865-4648-a8a6-dba748a01e14 for instance c8480a7c-b5de-4f66-a4f0-08fc679b0dfd on user Apr 23 03:57:39 user devstack@n-api.service[61307]: INFO nova.api.openstack.requestlog [req-196ab89b-66af-4b75-9818-25e02b57f19b req-f042bc7b-5255-4b45-aa71-6f86392b6979 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.112568 Apr 23 03:57:39 user devstack@n-api.service[61307]: [pid: 61307|app: 0|req: 119/357] 10.0.0.210 () {68 vars in 1394 bytes} [Sun Apr 23 03:57:39 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 23 03:57:40 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi [req-6ffe909a-0a16-4b63-b2ea-3db131d95fbc req-01af52cf-1b84-4ee9-b5c3-8e39ef16c569 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8480a7c-b5de-4f66-a4f0-08fc679b0dfd", "name": "network-vif-deleted", "tag": "e7548d21-c865-4648-a8a6-dba748a01e14"}]} {{(pid=61308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 03:57:40 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [req-6ffe909a-0a16-4b63-b2ea-3db131d95fbc req-01af52cf-1b84-4ee9-b5c3-8e39ef16c569 service nova] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:57:40 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [req-6ffe909a-0a16-4b63-b2ea-3db131d95fbc req-01af52cf-1b84-4ee9-b5c3-8e39ef16c569 service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:57:40 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [req-6ffe909a-0a16-4b63-b2ea-3db131d95fbc req-01af52cf-1b84-4ee9-b5c3-8e39ef16c569 service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:57:40 user devstack@n-api.service[61308]: INFO nova.api.openstack.compute.server_external_events [req-6ffe909a-0a16-4b63-b2ea-3db131d95fbc req-01af52cf-1b84-4ee9-b5c3-8e39ef16c569 service nova] Creating event network-vif-deleted:e7548d21-c865-4648-a8a6-dba748a01e14 for instance c8480a7c-b5de-4f66-a4f0-08fc679b0dfd on user Apr 23 03:57:40 user devstack@n-api.service[61308]: INFO nova.api.openstack.requestlog [req-6ffe909a-0a16-4b63-b2ea-3db131d95fbc req-01af52cf-1b84-4ee9-b5c3-8e39ef16c569 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087992 Apr 23 03:57:40 user devstack@n-api.service[61308]: [pid: 61308|app: 0|req: 122/358] 10.0.0.210 () {68 vars in 1394 bytes} [Sun Apr 23 03:57:40 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 23 03:57:41 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi [req-f5097bbb-dbdd-4610-8089-a1858566e67a req-b2aae0e8-2b05-42e6-8072-2c901031f206 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8480a7c-b5de-4f66-a4f0-08fc679b0dfd", "name": "network-vif-plugged", "status": "completed", "tag": "e7548d21-c865-4648-a8a6-dba748a01e14"}]} {{(pid=61306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 03:57:41 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [req-f5097bbb-dbdd-4610-8089-a1858566e67a req-b2aae0e8-2b05-42e6-8072-2c901031f206 service nova] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:57:41 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [req-f5097bbb-dbdd-4610-8089-a1858566e67a req-b2aae0e8-2b05-42e6-8072-2c901031f206 service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:57:41 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [req-f5097bbb-dbdd-4610-8089-a1858566e67a req-b2aae0e8-2b05-42e6-8072-2c901031f206 service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:57:41 user devstack@n-api.service[61306]: INFO nova.api.openstack.compute.server_external_events [req-f5097bbb-dbdd-4610-8089-a1858566e67a req-b2aae0e8-2b05-42e6-8072-2c901031f206 service nova] Creating event network-vif-plugged:e7548d21-c865-4648-a8a6-dba748a01e14 for instance c8480a7c-b5de-4f66-a4f0-08fc679b0dfd on user Apr 23 03:57:41 user devstack@n-api.service[61306]: INFO nova.api.openstack.requestlog [req-f5097bbb-dbdd-4610-8089-a1858566e67a req-b2aae0e8-2b05-42e6-8072-2c901031f206 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040462 Apr 23 03:57:41 user devstack@n-api.service[61306]: [pid: 61306|app: 0|req: 118/359] 10.0.0.210 () {68 vars in 1394 bytes} [Sun Apr 23 03:57:41 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 23 03:58:10 user devstack@n-api.service[61307]: DEBUG dbcounter [-] [61307] Writing DB stats nova_api:SELECT=4 {{(pid=61307) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:58:10 user devstack@n-api.service[61307]: DEBUG dbcounter [-] [61307] Writing DB stats nova_cell1:SELECT=4 {{(pid=61307) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:58:10 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi [None req-de3c3773-3eba-41cb-80b6-fb57a083dcfa tempest-ServersNegativeTestJSON-1115615559 tempest-ServersNegativeTestJSON-1115615559-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1132169926", "imageRef": "e6127373-9931-4277-9458-eceef653ea1e", "flavorRef": "42", "networks": [{"uuid": "083ef998-5361-46b7-827f-d0f086e9e552"}]}} {{(pid=61307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 03:58:11 user devstack@n-api.service[61307]: DEBUG nova.network.neutron [None req-de3c3773-3eba-41cb-80b6-fb57a083dcfa tempest-ServersNegativeTestJSON-1115615559 tempest-ServersNegativeTestJSON-1115615559-project-member] validate_networks() for [('083ef998-5361-46b7-827f-d0f086e9e552', None, None, None, None, None)] {{(pid=61307) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 23 03:58:11 user devstack@n-api.service[61307]: DEBUG nova.virt.hardware [None req-de3c3773-3eba-41cb-80b6-fb57a083dcfa tempest-ServersNegativeTestJSON-1115615559 tempest-ServersNegativeTestJSON-1115615559-project-member] Flavor limits 0:0:0 {{(pid=61307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 23 03:58:11 user devstack@n-api.service[61307]: DEBUG nova.virt.hardware [None req-de3c3773-3eba-41cb-80b6-fb57a083dcfa tempest-ServersNegativeTestJSON-1115615559 tempest-ServersNegativeTestJSON-1115615559-project-member] Image limits 0:0:0 {{(pid=61307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 23 03:58:11 user devstack@n-api.service[61307]: DEBUG nova.virt.hardware [None req-de3c3773-3eba-41cb-80b6-fb57a083dcfa tempest-ServersNegativeTestJSON-1115615559 tempest-ServersNegativeTestJSON-1115615559-project-member] Flavor pref 0:0:0 {{(pid=61307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 23 03:58:11 user devstack@n-api.service[61307]: DEBUG nova.virt.hardware [None req-de3c3773-3eba-41cb-80b6-fb57a083dcfa tempest-ServersNegativeTestJSON-1115615559 tempest-ServersNegativeTestJSON-1115615559-project-member] Image pref 0:0:0 {{(pid=61307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 23 03:58:11 user devstack@n-api.service[61307]: DEBUG nova.virt.hardware [None req-de3c3773-3eba-41cb-80b6-fb57a083dcfa tempest-ServersNegativeTestJSON-1115615559 tempest-ServersNegativeTestJSON-1115615559-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 23 03:58:11 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-de3c3773-3eba-41cb-80b6-fb57a083dcfa tempest-ServersNegativeTestJSON-1115615559 tempest-ServersNegativeTestJSON-1115615559-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:58:11 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-de3c3773-3eba-41cb-80b6-fb57a083dcfa tempest-ServersNegativeTestJSON-1115615559 tempest-ServersNegativeTestJSON-1115615559-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:58:11 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-de3c3773-3eba-41cb-80b6-fb57a083dcfa tempest-ServersNegativeTestJSON-1115615559 tempest-ServersNegativeTestJSON-1115615559-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:58:11 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-de3c3773-3eba-41cb-80b6-fb57a083dcfa tempest-ServersNegativeTestJSON-1115615559 tempest-ServersNegativeTestJSON-1115615559-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:58:11 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-de3c3773-3eba-41cb-80b6-fb57a083dcfa tempest-ServersNegativeTestJSON-1115615559 tempest-ServersNegativeTestJSON-1115615559-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:58:11 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-de3c3773-3eba-41cb-80b6-fb57a083dcfa tempest-ServersNegativeTestJSON-1115615559 tempest-ServersNegativeTestJSON-1115615559-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:58:11 user devstack@n-api.service[61307]: DEBUG nova.quota [None req-de3c3773-3eba-41cb-80b6-fb57a083dcfa tempest-ServersNegativeTestJSON-1115615559 tempest-ServersNegativeTestJSON-1115615559-project-member] Getting quotas for project 39d6cb4cfcb2413f8039ee9febf1c046. Resources: {'ram', 'instances', 'cores'} {{(pid=61307) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 23 03:58:11 user devstack@n-api.service[61307]: DEBUG nova.quota [None req-de3c3773-3eba-41cb-80b6-fb57a083dcfa tempest-ServersNegativeTestJSON-1115615559 tempest-ServersNegativeTestJSON-1115615559-project-member] Getting quotas for user 45d9ae4a3b00492fa2fc16a22a34df09 and project 39d6cb4cfcb2413f8039ee9febf1c046. Resources: {'ram', 'instances', 'cores'} {{(pid=61307) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 23 03:58:11 user devstack@n-api.service[61307]: DEBUG nova.compute.api [None req-de3c3773-3eba-41cb-80b6-fb57a083dcfa tempest-ServersNegativeTestJSON-1115615559 tempest-ServersNegativeTestJSON-1115615559-project-member] Going to run 1 instances... {{(pid=61307) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 23 03:58:11 user devstack@n-api.service[61307]: DEBUG nova.compute.api [None req-de3c3773-3eba-41cb-80b6-fb57a083dcfa tempest-ServersNegativeTestJSON-1115615559 tempest-ServersNegativeTestJSON-1115615559-project-member] [instance: 994da665-4a5f-41ce-a104-febce8be2557] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e6127373-9931-4277-9458-eceef653ea1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61307) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 23 03:58:11 user devstack@n-api.service[61307]: INFO nova.api.openstack.requestlog [None req-de3c3773-3eba-41cb-80b6-fb57a083dcfa tempest-ServersNegativeTestJSON-1115615559 tempest-ServersNegativeTestJSON-1115615559-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.824064 Apr 23 03:58:11 user devstack@n-api.service[61307]: [pid: 61307|app: 0|req: 120/360] 10.0.0.210 () {64 vars in 1224 bytes} [Sun Apr 23 03:58:10 2023] POST /compute/v2.1/servers => generated 378 bytes in 826 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 23 03:58:11 user devstack@n-api.service[61308]: DEBUG dbcounter [-] [61308] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61308) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:58:11 user devstack@n-api.service[61308]: DEBUG dbcounter [-] [61308] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61308) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:58:11 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi [None req-f2a6201d-48e1-4f35-8350-e865cffac69a tempest-ServersNegativeTestJSON-1115615559 tempest-ServersNegativeTestJSON-1115615559-project-member] Calling method '>' {{(pid=61308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 03:58:11 user devstack@n-api.service[61308]: DEBUG nova.compute.api [None req-f2a6201d-48e1-4f35-8350-e865cffac69a tempest-ServersNegativeTestJSON-1115615559 tempest-ServersNegativeTestJSON-1115615559-project-member] [instance: 994da665-4a5f-41ce-a104-febce8be2557] Fetching instance by UUID {{(pid=61308) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 23 03:58:11 user devstack@n-api.service[61308]: DEBUG nova.policy [None req-f2a6201d-48e1-4f35-8350-e865cffac69a tempest-ServersNegativeTestJSON-1115615559 tempest-ServersNegativeTestJSON-1115615559-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d9ae4a3b00492fa2fc16a22a34df09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39d6cb4cfcb2413f8039ee9febf1c046', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61308) authorize /opt/stack/nova/nova/policy.py:203}} Apr 23 03:58:11 user devstack@n-api.service[61308]: INFO nova.api.openstack.requestlog [None req-f2a6201d-48e1-4f35-8350-e865cffac69a tempest-ServersNegativeTestJSON-1115615559 tempest-ServersNegativeTestJSON-1115615559-project-member] 10.0.0.210 "GET /compute/v2.1/servers/994da665-4a5f-41ce-a104-febce8be2557" status: 200 len: 1211 microversion: 2.1 time: 0.118454 Apr 23 03:58:11 user devstack@n-api.service[61308]: [pid: 61308|app: 0|req: 123/361] 10.0.0.210 () {62 vars in 1313 bytes} [Sun Apr 23 03:58:11 2023] GET /compute/v2.1/servers/994da665-4a5f-41ce-a104-febce8be2557 => generated 1211 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 23 03:58:14 user devstack@n-api.service[61306]: DEBUG dbcounter [-] [61306] Writing DB stats nova_api:SELECT=6 {{(pid=61306) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:58:14 user devstack@n-api.service[61306]: DEBUG dbcounter [-] [61306] Writing DB stats nova_cell1:SELECT=8 {{(pid=61306) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:58:14 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi [req-e4bca89c-723f-4953-94a2-74aa4aa3fe7b req-eeb16672-a5c2-44a8-9d00-61498b377236 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "994da665-4a5f-41ce-a104-febce8be2557", "tag": "7f5011fe-2339-41ec-b6db-535375a33a9d"}]} {{(pid=61306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 03:58:14 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [req-e4bca89c-723f-4953-94a2-74aa4aa3fe7b req-eeb16672-a5c2-44a8-9d00-61498b377236 service nova] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:58:14 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [req-e4bca89c-723f-4953-94a2-74aa4aa3fe7b req-eeb16672-a5c2-44a8-9d00-61498b377236 service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:58:14 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [req-e4bca89c-723f-4953-94a2-74aa4aa3fe7b req-eeb16672-a5c2-44a8-9d00-61498b377236 service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:58:14 user devstack@n-api.service[61306]: INFO nova.api.openstack.compute.server_external_events [req-e4bca89c-723f-4953-94a2-74aa4aa3fe7b req-eeb16672-a5c2-44a8-9d00-61498b377236 service nova] Creating event network-changed:7f5011fe-2339-41ec-b6db-535375a33a9d for instance 994da665-4a5f-41ce-a104-febce8be2557 on user Apr 23 03:58:14 user devstack@n-api.service[61306]: INFO nova.api.openstack.requestlog [req-e4bca89c-723f-4953-94a2-74aa4aa3fe7b req-eeb16672-a5c2-44a8-9d00-61498b377236 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039974 Apr 23 03:58:14 user devstack@n-api.service[61306]: [pid: 61306|app: 0|req: 119/362] 10.0.0.210 () {68 vars in 1394 bytes} [Sun Apr 23 03:58:14 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 23 03:58:16 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi [req-36325053-1a26-476a-8a18-c45778c789d1 req-758e6ec2-32ca-4ed6-ad3f-997ef953d158 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "994da665-4a5f-41ce-a104-febce8be2557", "name": "network-vif-plugged", "status": "completed", "tag": "7f5011fe-2339-41ec-b6db-535375a33a9d"}]} {{(pid=61307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 03:58:16 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [req-36325053-1a26-476a-8a18-c45778c789d1 req-758e6ec2-32ca-4ed6-ad3f-997ef953d158 service nova] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:58:16 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [req-36325053-1a26-476a-8a18-c45778c789d1 req-758e6ec2-32ca-4ed6-ad3f-997ef953d158 service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:58:16 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [req-36325053-1a26-476a-8a18-c45778c789d1 req-758e6ec2-32ca-4ed6-ad3f-997ef953d158 service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:58:16 user devstack@n-api.service[61307]: INFO nova.api.openstack.compute.server_external_events [req-36325053-1a26-476a-8a18-c45778c789d1 req-758e6ec2-32ca-4ed6-ad3f-997ef953d158 service nova] Creating event network-vif-plugged:7f5011fe-2339-41ec-b6db-535375a33a9d for instance 994da665-4a5f-41ce-a104-febce8be2557 on user Apr 23 03:58:16 user devstack@n-api.service[61307]: INFO nova.api.openstack.requestlog [req-36325053-1a26-476a-8a18-c45778c789d1 req-758e6ec2-32ca-4ed6-ad3f-997ef953d158 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097621 Apr 23 03:58:16 user devstack@n-api.service[61307]: [pid: 61307|app: 0|req: 121/363] 10.0.0.210 () {68 vars in 1394 bytes} [Sun Apr 23 03:58:16 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 23 03:58:18 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi [req-1131464c-573c-4596-8396-371b9ffa03fb req-dec2ac02-566f-4170-b7cf-4eb19b715313 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "994da665-4a5f-41ce-a104-febce8be2557", "name": "network-vif-plugged", "status": "completed", "tag": "7f5011fe-2339-41ec-b6db-535375a33a9d"}]} {{(pid=61308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 03:58:18 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [req-1131464c-573c-4596-8396-371b9ffa03fb req-dec2ac02-566f-4170-b7cf-4eb19b715313 service nova] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:58:18 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [req-1131464c-573c-4596-8396-371b9ffa03fb req-dec2ac02-566f-4170-b7cf-4eb19b715313 service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:58:18 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [req-1131464c-573c-4596-8396-371b9ffa03fb req-dec2ac02-566f-4170-b7cf-4eb19b715313 service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:58:18 user devstack@n-api.service[61308]: INFO nova.api.openstack.compute.server_external_events [req-1131464c-573c-4596-8396-371b9ffa03fb req-dec2ac02-566f-4170-b7cf-4eb19b715313 service nova] Creating event network-vif-plugged:7f5011fe-2339-41ec-b6db-535375a33a9d for instance 994da665-4a5f-41ce-a104-febce8be2557 on user Apr 23 03:58:18 user devstack@n-api.service[61308]: INFO nova.api.openstack.requestlog [req-1131464c-573c-4596-8396-371b9ffa03fb req-dec2ac02-566f-4170-b7cf-4eb19b715313 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051779 Apr 23 03:58:18 user devstack@n-api.service[61308]: [pid: 61308|app: 0|req: 124/364] 10.0.0.210 () {68 vars in 1394 bytes} [Sun Apr 23 03:58:18 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 23 03:58:29 user devstack@n-api.service[61306]: DEBUG dbcounter [-] [61306] Writing DB stats nova_api:SELECT=2 {{(pid=61306) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:58:29 user devstack@n-api.service[61306]: DEBUG dbcounter [-] [61306] Writing DB stats nova_cell1:SELECT=2 {{(pid=61306) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:58:29 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi [None req-60c4383f-ffd8-4744-bc7b-4efcafc1102b tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Calling method '>' {{(pid=61306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 03:58:29 user devstack@n-api.service[61306]: DEBUG nova.compute.api [None req-60c4383f-ffd8-4744-bc7b-4efcafc1102b tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] [instance: c8480a7c-b5de-4f66-a4f0-08fc679b0dfd] Fetching instance by UUID {{(pid=61306) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 23 03:58:29 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-60c4383f-ffd8-4744-bc7b-4efcafc1102b tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:58:29 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-60c4383f-ffd8-4744-bc7b-4efcafc1102b tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:58:29 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-60c4383f-ffd8-4744-bc7b-4efcafc1102b tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:58:29 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-60c4383f-ffd8-4744-bc7b-4efcafc1102b tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:58:29 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-60c4383f-ffd8-4744-bc7b-4efcafc1102b tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:58:29 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-60c4383f-ffd8-4744-bc7b-4efcafc1102b tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:58:29 user devstack@n-api.service[61306]: INFO nova.api.openstack.wsgi [None req-60c4383f-ffd8-4744-bc7b-4efcafc1102b tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] HTTP exception thrown: Instance c8480a7c-b5de-4f66-a4f0-08fc679b0dfd could not be found. Apr 23 03:58:29 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi [None req-60c4383f-ffd8-4744-bc7b-4efcafc1102b tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Request method failure captured: Apr 23 03:58:29 user devstack@n-api.service[61306]: request: GET /compute/v2.1/servers/c8480a7c-b5de-4f66-a4f0-08fc679b0dfd HTTP/1.1 Apr 23 03:58:29 user devstack@n-api.service[61306]: Accept: application/json Apr 23 03:58:29 user devstack@n-api.service[61306]: Accept-Encoding: identity Apr 23 03:58:29 user devstack@n-api.service[61306]: Connection: close Apr 23 03:58:29 user devstack@n-api.service[61306]: Content-Length: 0 Apr 23 03:58:29 user devstack@n-api.service[61306]: Content-Type: application/json Apr 23 03:58:29 user devstack@n-api.service[61306]: Host: 10.0.0.210 Apr 23 03:58:29 user devstack@n-api.service[61306]: Openstack-System-Scope: None Apr 23 03:58:29 user devstack@n-api.service[61306]: User-Agent: python-urllib3/1.26.15 Apr 23 03:58:29 user devstack@n-api.service[61306]: X-Auth-Token: gAAAAABkRKqymTVo46ELxd1uSw-EAoRR5lujatiDr7IMoAhu4i8DKWULtOBBybCOSHvaEwkXcd5s0zATq7gbIXqGH0um8sKXUKLCZOTVf0WZe1CrOig4R-b1xOF2MgBI4Lr-InRHxovj2jR4wzIZeUUz6B2eBSbR5fbWI_3Fzi1ZiHFHIpTIGPE Apr 23 03:58:29 user devstack@n-api.service[61306]: X-Domain-Id: None Apr 23 03:58:29 user devstack@n-api.service[61306]: X-Domain-Name: None Apr 23 03:58:29 user devstack@n-api.service[61306]: X-Identity-Status: Confirmed Apr 23 03:58:29 user devstack@n-api.service[61306]: X-Is-Admin-Project: True Apr 23 03:58:29 user devstack@n-api.service[61306]: X-Openstack-Nova-Api-Version: 2.87 Apr 23 03:58:29 user devstack@n-api.service[61306]: X-Project-Domain-Id: default Apr 23 03:58:29 user devstack@n-api.service[61306]: X-Project-Domain-Name: Default Apr 23 03:58:29 user devstack@n-api.service[61306]: X-Project-Id: a79e09b1c4ae4cc5ab11c3e56ee4f0d9 Apr 23 03:58:29 user devstack@n-api.service[61306]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-653032906 Apr 23 03:58:29 user devstack@n-api.service[61306]: X-Role: reader,member Apr 23 03:58:29 user devstack@n-api.service[61306]: X-Roles: reader,member Apr 23 03:58:29 user devstack@n-api.service[61306]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a79e09b1c4ae4cc5ab11c3e56ee4f0d9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a79e09b1c4ae4cc5ab11c3e56ee4f0d9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a79e09b1c4ae4cc5ab11c3e56ee4f0d9"}]}] Apr 23 03:58:29 user devstack@n-api.service[61306]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-653032906 Apr 23 03:58:29 user devstack@n-api.service[61306]: X-Tenant-Id: a79e09b1c4ae4cc5ab11c3e56ee4f0d9 Apr 23 03:58:29 user devstack@n-api.service[61306]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-653032906 Apr 23 03:58:29 user devstack@n-api.service[61306]: X-User: tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member Apr 23 03:58:29 user devstack@n-api.service[61306]: X-User-Domain-Id: default Apr 23 03:58:29 user devstack@n-api.service[61306]: X-User-Domain-Name: Default Apr 23 03:58:29 user devstack@n-api.service[61306]: X-User-Id: 99495726467944c38620831fc93e2856 Apr 23 03:58:29 user devstack@n-api.service[61306]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member Apr 23 03:58:29 user devstack@n-api.service[61306]: method: > Apr 23 03:58:29 user devstack@n-api.service[61306]: exception: Instance c8480a7c-b5de-4f66-a4f0-08fc679b0dfd could not be found. Apr 23 03:58:29 user devstack@n-api.service[61306]: action_args: {'id': 'c8480a7c-b5de-4f66-a4f0-08fc679b0dfd'} Apr 23 03:58:29 user devstack@n-api.service[61306]: {{(pid=61306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 23 03:58:29 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 23 03:58:29 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 23 03:58:29 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 23 03:58:29 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 23 03:58:29 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 23 03:58:29 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 23 03:58:29 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 23 03:58:29 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 23 03:58:29 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 23 03:58:29 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8480a7c-b5de-4f66-a4f0-08fc679b0dfd could not be found. Apr 23 03:58:29 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi Apr 23 03:58:29 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 23 03:58:29 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi Apr 23 03:58:29 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 23 03:58:29 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 23 03:58:29 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 23 03:58:29 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 23 03:58:29 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 23 03:58:29 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 23 03:58:29 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 23 03:58:29 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 23 03:58:29 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 23 03:58:29 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 23 03:58:29 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 23 03:58:29 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 23 03:58:29 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 23 03:58:29 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8480a7c-b5de-4f66-a4f0-08fc679b0dfd could not be found. Apr 23 03:58:29 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi Apr 23 03:58:29 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 23 03:58:29 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi Apr 23 03:58:29 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 23 03:58:29 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 23 03:58:29 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 23 03:58:29 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 23 03:58:29 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 23 03:58:29 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8480a7c-b5de-4f66-a4f0-08fc679b0dfd could not be found. Apr 23 03:58:29 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi Apr 23 03:58:29 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi [None req-60c4383f-ffd8-4744-bc7b-4efcafc1102b tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] Returning 404 to user: Instance c8480a7c-b5de-4f66-a4f0-08fc679b0dfd could not be found. {{(pid=61306) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 23 03:58:29 user devstack@n-api.service[61306]: INFO nova.api.openstack.requestlog [None req-60c4383f-ffd8-4744-bc7b-4efcafc1102b tempest-ServerBootFromVolumeStableRescueTest-653032906 tempest-ServerBootFromVolumeStableRescueTest-653032906-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c8480a7c-b5de-4f66-a4f0-08fc679b0dfd" status: 404 len: 111 microversion: 2.87 time: 0.030753 Apr 23 03:58:29 user devstack@n-api.service[61306]: [pid: 61306|app: 0|req: 120/365] 10.0.0.210 () {64 vars in 1354 bytes} [Sun Apr 23 03:58:29 2023] GET /compute/v2.1/servers/c8480a7c-b5de-4f66-a4f0-08fc679b0dfd => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 23 03:58:39 user devstack@n-api.service[61307]: DEBUG dbcounter [-] [61307] Writing DB stats nova_cell0:SELECT=2 {{(pid=61307) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:58:39 user devstack@n-api.service[61307]: DEBUG dbcounter [-] [61307] Writing DB stats nova_cell0:SELECT=6 {{(pid=61307) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:58:39 user devstack@n-api.service[61307]: DEBUG dbcounter [-] [61307] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=3 {{(pid=61307) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:58:39 user devstack@n-api.service[61307]: DEBUG dbcounter [-] [61307] Writing DB stats nova_cell1:SELECT=4 {{(pid=61307) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:58:39 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi [None req-9e940828-61eb-4d16-9eeb-de6764890000 tempest-ServerRescueNegativeTestJSON-509507797 tempest-ServerRescueNegativeTestJSON-509507797-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1213396490", "imageRef": "e6127373-9931-4277-9458-eceef653ea1e", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=61307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 03:58:39 user devstack@n-api.service[61307]: DEBUG nova.network.neutron [None req-9e940828-61eb-4d16-9eeb-de6764890000 tempest-ServerRescueNegativeTestJSON-509507797 tempest-ServerRescueNegativeTestJSON-509507797-project-member] validate_networks() for [('5aff0e90-d0f3-4716-9f61-98dc8c049108', None, None, None, None, None)] {{(pid=61307) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 23 03:58:39 user devstack@n-api.service[61307]: DEBUG nova.virt.hardware [None req-9e940828-61eb-4d16-9eeb-de6764890000 tempest-ServerRescueNegativeTestJSON-509507797 tempest-ServerRescueNegativeTestJSON-509507797-project-member] Flavor limits 0:0:0 {{(pid=61307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 23 03:58:39 user devstack@n-api.service[61307]: DEBUG nova.virt.hardware [None req-9e940828-61eb-4d16-9eeb-de6764890000 tempest-ServerRescueNegativeTestJSON-509507797 tempest-ServerRescueNegativeTestJSON-509507797-project-member] Image limits 0:0:0 {{(pid=61307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 23 03:58:39 user devstack@n-api.service[61307]: DEBUG nova.virt.hardware [None req-9e940828-61eb-4d16-9eeb-de6764890000 tempest-ServerRescueNegativeTestJSON-509507797 tempest-ServerRescueNegativeTestJSON-509507797-project-member] Flavor pref 0:0:0 {{(pid=61307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 23 03:58:39 user devstack@n-api.service[61307]: DEBUG nova.virt.hardware [None req-9e940828-61eb-4d16-9eeb-de6764890000 tempest-ServerRescueNegativeTestJSON-509507797 tempest-ServerRescueNegativeTestJSON-509507797-project-member] Image pref 0:0:0 {{(pid=61307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 23 03:58:39 user devstack@n-api.service[61307]: DEBUG nova.virt.hardware [None req-9e940828-61eb-4d16-9eeb-de6764890000 tempest-ServerRescueNegativeTestJSON-509507797 tempest-ServerRescueNegativeTestJSON-509507797-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 23 03:58:39 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-9e940828-61eb-4d16-9eeb-de6764890000 tempest-ServerRescueNegativeTestJSON-509507797 tempest-ServerRescueNegativeTestJSON-509507797-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:58:39 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-9e940828-61eb-4d16-9eeb-de6764890000 tempest-ServerRescueNegativeTestJSON-509507797 tempest-ServerRescueNegativeTestJSON-509507797-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:58:39 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-9e940828-61eb-4d16-9eeb-de6764890000 tempest-ServerRescueNegativeTestJSON-509507797 tempest-ServerRescueNegativeTestJSON-509507797-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:58:39 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-9e940828-61eb-4d16-9eeb-de6764890000 tempest-ServerRescueNegativeTestJSON-509507797 tempest-ServerRescueNegativeTestJSON-509507797-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:58:39 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-9e940828-61eb-4d16-9eeb-de6764890000 tempest-ServerRescueNegativeTestJSON-509507797 tempest-ServerRescueNegativeTestJSON-509507797-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:58:39 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-9e940828-61eb-4d16-9eeb-de6764890000 tempest-ServerRescueNegativeTestJSON-509507797 tempest-ServerRescueNegativeTestJSON-509507797-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:58:39 user devstack@n-api.service[61307]: DEBUG nova.quota [None req-9e940828-61eb-4d16-9eeb-de6764890000 tempest-ServerRescueNegativeTestJSON-509507797 tempest-ServerRescueNegativeTestJSON-509507797-project-member] Getting quotas for project db4b7bdc478946e2ad0a2060b433b42c. Resources: {'ram', 'instances', 'cores'} {{(pid=61307) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 23 03:58:39 user devstack@n-api.service[61307]: DEBUG nova.quota [None req-9e940828-61eb-4d16-9eeb-de6764890000 tempest-ServerRescueNegativeTestJSON-509507797 tempest-ServerRescueNegativeTestJSON-509507797-project-member] Getting quotas for user 84b2f522c7164c5c934b8bbf113b542a and project db4b7bdc478946e2ad0a2060b433b42c. Resources: {'ram', 'instances', 'cores'} {{(pid=61307) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 23 03:58:39 user devstack@n-api.service[61307]: DEBUG nova.compute.api [None req-9e940828-61eb-4d16-9eeb-de6764890000 tempest-ServerRescueNegativeTestJSON-509507797 tempest-ServerRescueNegativeTestJSON-509507797-project-member] Going to run 1 instances... {{(pid=61307) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 23 03:58:39 user devstack@n-api.service[61307]: DEBUG nova.compute.api [None req-9e940828-61eb-4d16-9eeb-de6764890000 tempest-ServerRescueNegativeTestJSON-509507797 tempest-ServerRescueNegativeTestJSON-509507797-project-member] [instance: 27abe5af-8845-40e6-a9c3-12399369b117] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e6127373-9931-4277-9458-eceef653ea1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61307) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 23 03:58:39 user devstack@n-api.service[61307]: INFO nova.api.openstack.requestlog [None req-9e940828-61eb-4d16-9eeb-de6764890000 tempest-ServerRescueNegativeTestJSON-509507797 tempest-ServerRescueNegativeTestJSON-509507797-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 381 microversion: 2.1 time: 0.732417 Apr 23 03:58:39 user devstack@n-api.service[61307]: [pid: 61307|app: 0|req: 122/366] 10.0.0.210 () {64 vars in 1224 bytes} [Sun Apr 23 03:58:39 2023] POST /compute/v2.1/servers => generated 381 bytes in 735 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 23 03:58:39 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi [None req-ea9a6cb9-9ce0-49c8-8b53-1429d635d8be tempest-ServerRescueNegativeTestJSON-509507797 tempest-ServerRescueNegativeTestJSON-509507797-project-member] Calling method '>' {{(pid=61308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 03:58:39 user devstack@n-api.service[61308]: DEBUG nova.compute.api [None req-ea9a6cb9-9ce0-49c8-8b53-1429d635d8be tempest-ServerRescueNegativeTestJSON-509507797 tempest-ServerRescueNegativeTestJSON-509507797-project-member] [instance: 27abe5af-8845-40e6-a9c3-12399369b117] Fetching instance by UUID {{(pid=61308) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 23 03:58:39 user devstack@n-api.service[61308]: DEBUG dbcounter [-] [61308] Writing DB stats nova_cell0:SELECT=2 {{(pid=61308) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:58:39 user devstack@n-api.service[61308]: DEBUG dbcounter [-] [61308] Writing DB stats nova_api:SELECT=6 {{(pid=61308) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:58:39 user devstack@n-api.service[61308]: DEBUG dbcounter [-] [61308] Writing DB stats nova_cell1:SELECT=2 {{(pid=61308) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:58:39 user devstack@n-api.service[61308]: DEBUG nova.policy [None req-ea9a6cb9-9ce0-49c8-8b53-1429d635d8be tempest-ServerRescueNegativeTestJSON-509507797 tempest-ServerRescueNegativeTestJSON-509507797-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b2f522c7164c5c934b8bbf113b542a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db4b7bdc478946e2ad0a2060b433b42c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61308) authorize /opt/stack/nova/nova/policy.py:203}} Apr 23 03:58:39 user devstack@n-api.service[61308]: INFO nova.api.openstack.requestlog [None req-ea9a6cb9-9ce0-49c8-8b53-1429d635d8be tempest-ServerRescueNegativeTestJSON-509507797 tempest-ServerRescueNegativeTestJSON-509507797-project-member] 10.0.0.210 "GET /compute/v2.1/servers/27abe5af-8845-40e6-a9c3-12399369b117" status: 200 len: 1216 microversion: 2.1 time: 0.070893 Apr 23 03:58:39 user devstack@n-api.service[61308]: [pid: 61308|app: 0|req: 125/367] 10.0.0.210 () {62 vars in 1313 bytes} [Sun Apr 23 03:58:39 2023] GET /compute/v2.1/servers/27abe5af-8845-40e6-a9c3-12399369b117 => generated 1216 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 23 03:58:39 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi [None req-86b9a6ad-34e9-4be8-a8d0-cd291abad83d tempest-ServerRescueNegativeTestJSON-509507797 tempest-ServerRescueNegativeTestJSON-509507797-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1609850900", "imageRef": "e6127373-9931-4277-9458-eceef653ea1e", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=61306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 03:58:39 user devstack@n-api.service[61306]: DEBUG dbcounter [-] [61306] Writing DB stats nova_api:SELECT=2 {{(pid=61306) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:58:39 user devstack@n-api.service[61306]: DEBUG dbcounter [-] [61306] Writing DB stats nova_cell1:SELECT=2 {{(pid=61306) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:58:39 user devstack@n-api.service[61306]: DEBUG nova.network.neutron [None req-86b9a6ad-34e9-4be8-a8d0-cd291abad83d tempest-ServerRescueNegativeTestJSON-509507797 tempest-ServerRescueNegativeTestJSON-509507797-project-member] validate_networks() for [('5aff0e90-d0f3-4716-9f61-98dc8c049108', None, None, None, None, None)] {{(pid=61306) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 23 03:58:40 user devstack@n-api.service[61306]: DEBUG nova.virt.hardware [None req-86b9a6ad-34e9-4be8-a8d0-cd291abad83d tempest-ServerRescueNegativeTestJSON-509507797 tempest-ServerRescueNegativeTestJSON-509507797-project-member] Flavor limits 0:0:0 {{(pid=61306) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 23 03:58:40 user devstack@n-api.service[61306]: DEBUG nova.virt.hardware [None req-86b9a6ad-34e9-4be8-a8d0-cd291abad83d tempest-ServerRescueNegativeTestJSON-509507797 tempest-ServerRescueNegativeTestJSON-509507797-project-member] Image limits 0:0:0 {{(pid=61306) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 23 03:58:40 user devstack@n-api.service[61306]: DEBUG nova.virt.hardware [None req-86b9a6ad-34e9-4be8-a8d0-cd291abad83d tempest-ServerRescueNegativeTestJSON-509507797 tempest-ServerRescueNegativeTestJSON-509507797-project-member] Flavor pref 0:0:0 {{(pid=61306) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 23 03:58:40 user devstack@n-api.service[61306]: DEBUG nova.virt.hardware [None req-86b9a6ad-34e9-4be8-a8d0-cd291abad83d tempest-ServerRescueNegativeTestJSON-509507797 tempest-ServerRescueNegativeTestJSON-509507797-project-member] Image pref 0:0:0 {{(pid=61306) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 23 03:58:40 user devstack@n-api.service[61306]: DEBUG nova.virt.hardware [None req-86b9a6ad-34e9-4be8-a8d0-cd291abad83d tempest-ServerRescueNegativeTestJSON-509507797 tempest-ServerRescueNegativeTestJSON-509507797-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61306) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 23 03:58:40 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-86b9a6ad-34e9-4be8-a8d0-cd291abad83d tempest-ServerRescueNegativeTestJSON-509507797 tempest-ServerRescueNegativeTestJSON-509507797-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:58:40 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-86b9a6ad-34e9-4be8-a8d0-cd291abad83d tempest-ServerRescueNegativeTestJSON-509507797 tempest-ServerRescueNegativeTestJSON-509507797-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:58:40 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-86b9a6ad-34e9-4be8-a8d0-cd291abad83d tempest-ServerRescueNegativeTestJSON-509507797 tempest-ServerRescueNegativeTestJSON-509507797-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:58:40 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-86b9a6ad-34e9-4be8-a8d0-cd291abad83d tempest-ServerRescueNegativeTestJSON-509507797 tempest-ServerRescueNegativeTestJSON-509507797-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:58:40 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-86b9a6ad-34e9-4be8-a8d0-cd291abad83d tempest-ServerRescueNegativeTestJSON-509507797 tempest-ServerRescueNegativeTestJSON-509507797-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:58:40 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-86b9a6ad-34e9-4be8-a8d0-cd291abad83d tempest-ServerRescueNegativeTestJSON-509507797 tempest-ServerRescueNegativeTestJSON-509507797-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:58:40 user devstack@n-api.service[61306]: DEBUG nova.quota [None req-86b9a6ad-34e9-4be8-a8d0-cd291abad83d tempest-ServerRescueNegativeTestJSON-509507797 tempest-ServerRescueNegativeTestJSON-509507797-project-member] Getting quotas for project db4b7bdc478946e2ad0a2060b433b42c. Resources: {'ram', 'instances', 'cores'} {{(pid=61306) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 23 03:58:40 user devstack@n-api.service[61306]: DEBUG nova.quota [None req-86b9a6ad-34e9-4be8-a8d0-cd291abad83d tempest-ServerRescueNegativeTestJSON-509507797 tempest-ServerRescueNegativeTestJSON-509507797-project-member] Getting quotas for user 84b2f522c7164c5c934b8bbf113b542a and project db4b7bdc478946e2ad0a2060b433b42c. Resources: {'ram', 'instances', 'cores'} {{(pid=61306) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 23 03:58:40 user devstack@n-api.service[61306]: DEBUG nova.compute.api [None req-86b9a6ad-34e9-4be8-a8d0-cd291abad83d tempest-ServerRescueNegativeTestJSON-509507797 tempest-ServerRescueNegativeTestJSON-509507797-project-member] Going to run 1 instances... {{(pid=61306) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 23 03:58:40 user devstack@n-api.service[61306]: DEBUG nova.compute.api [None req-86b9a6ad-34e9-4be8-a8d0-cd291abad83d tempest-ServerRescueNegativeTestJSON-509507797 tempest-ServerRescueNegativeTestJSON-509507797-project-member] [instance: 7d5ef4db-70d7-4545-9ddb-92ecdf4ebb23] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e6127373-9931-4277-9458-eceef653ea1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61306) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 23 03:58:40 user devstack@n-api.service[61306]: INFO nova.api.openstack.requestlog [None req-86b9a6ad-34e9-4be8-a8d0-cd291abad83d tempest-ServerRescueNegativeTestJSON-509507797 tempest-ServerRescueNegativeTestJSON-509507797-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 381 microversion: 2.1 time: 0.646405 Apr 23 03:58:40 user devstack@n-api.service[61306]: [pid: 61306|app: 0|req: 121/368] 10.0.0.210 () {64 vars in 1224 bytes} [Sun Apr 23 03:58:39 2023] POST /compute/v2.1/servers => generated 381 bytes in 648 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 23 03:58:40 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi [None req-cfe0a0d9-264e-406f-bb9d-0e3cc1175a46 tempest-ServerRescueNegativeTestJSON-509507797 tempest-ServerRescueNegativeTestJSON-509507797-project-member] Calling method '>' {{(pid=61307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 03:58:40 user devstack@n-api.service[61307]: DEBUG nova.compute.api [None req-cfe0a0d9-264e-406f-bb9d-0e3cc1175a46 tempest-ServerRescueNegativeTestJSON-509507797 tempest-ServerRescueNegativeTestJSON-509507797-project-member] [instance: 7d5ef4db-70d7-4545-9ddb-92ecdf4ebb23] Fetching instance by UUID {{(pid=61307) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 23 03:58:40 user devstack@n-api.service[61307]: DEBUG nova.policy [None req-cfe0a0d9-264e-406f-bb9d-0e3cc1175a46 tempest-ServerRescueNegativeTestJSON-509507797 tempest-ServerRescueNegativeTestJSON-509507797-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b2f522c7164c5c934b8bbf113b542a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db4b7bdc478946e2ad0a2060b433b42c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61307) authorize /opt/stack/nova/nova/policy.py:203}} Apr 23 03:58:40 user devstack@n-api.service[61307]: INFO nova.api.openstack.requestlog [None req-cfe0a0d9-264e-406f-bb9d-0e3cc1175a46 tempest-ServerRescueNegativeTestJSON-509507797 tempest-ServerRescueNegativeTestJSON-509507797-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7d5ef4db-70d7-4545-9ddb-92ecdf4ebb23" status: 200 len: 1216 microversion: 2.1 time: 0.063758 Apr 23 03:58:40 user devstack@n-api.service[61307]: [pid: 61307|app: 0|req: 123/369] 10.0.0.210 () {62 vars in 1313 bytes} [Sun Apr 23 03:58:40 2023] GET /compute/v2.1/servers/7d5ef4db-70d7-4545-9ddb-92ecdf4ebb23 => generated 1216 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 23 03:58:42 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi [req-6d097eb4-0646-491a-b596-fe8cd5b1d987 req-5723d892-e272-4888-a97d-8f023baf3682 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27abe5af-8845-40e6-a9c3-12399369b117", "tag": "85c6dc8b-d8a7-4df1-a8a5-667f7d80e42d"}]} {{(pid=61308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 03:58:42 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [req-6d097eb4-0646-491a-b596-fe8cd5b1d987 req-5723d892-e272-4888-a97d-8f023baf3682 service nova] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:58:42 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [req-6d097eb4-0646-491a-b596-fe8cd5b1d987 req-5723d892-e272-4888-a97d-8f023baf3682 service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:58:42 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [req-6d097eb4-0646-491a-b596-fe8cd5b1d987 req-5723d892-e272-4888-a97d-8f023baf3682 service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:58:42 user devstack@n-api.service[61308]: INFO nova.api.openstack.compute.server_external_events [req-6d097eb4-0646-491a-b596-fe8cd5b1d987 req-5723d892-e272-4888-a97d-8f023baf3682 service nova] Creating event network-changed:85c6dc8b-d8a7-4df1-a8a5-667f7d80e42d for instance 27abe5af-8845-40e6-a9c3-12399369b117 on user Apr 23 03:58:42 user devstack@n-api.service[61308]: INFO nova.api.openstack.requestlog [req-6d097eb4-0646-491a-b596-fe8cd5b1d987 req-5723d892-e272-4888-a97d-8f023baf3682 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030908 Apr 23 03:58:42 user devstack@n-api.service[61308]: [pid: 61308|app: 0|req: 126/370] 10.0.0.210 () {68 vars in 1394 bytes} [Sun Apr 23 03:58:42 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 23 03:58:44 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi [req-d5a7af4d-37c4-47e5-b432-5cb553ff94fc req-873b43b5-5761-4048-9709-558aaf0c729d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d5ef4db-70d7-4545-9ddb-92ecdf4ebb23", "tag": "c79b33fd-e966-4247-a5e7-3b6ee20d635c"}]} {{(pid=61306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 03:58:44 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [req-d5a7af4d-37c4-47e5-b432-5cb553ff94fc req-873b43b5-5761-4048-9709-558aaf0c729d service nova] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:58:44 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [req-d5a7af4d-37c4-47e5-b432-5cb553ff94fc req-873b43b5-5761-4048-9709-558aaf0c729d service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:58:44 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [req-d5a7af4d-37c4-47e5-b432-5cb553ff94fc req-873b43b5-5761-4048-9709-558aaf0c729d service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:58:44 user devstack@n-api.service[61306]: INFO nova.api.openstack.compute.server_external_events [req-d5a7af4d-37c4-47e5-b432-5cb553ff94fc req-873b43b5-5761-4048-9709-558aaf0c729d service nova] Creating event network-changed:c79b33fd-e966-4247-a5e7-3b6ee20d635c for instance 7d5ef4db-70d7-4545-9ddb-92ecdf4ebb23 on user Apr 23 03:58:44 user devstack@n-api.service[61306]: INFO nova.api.openstack.requestlog [req-d5a7af4d-37c4-47e5-b432-5cb553ff94fc req-873b43b5-5761-4048-9709-558aaf0c729d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031540 Apr 23 03:58:44 user devstack@n-api.service[61306]: [pid: 61306|app: 0|req: 122/371] 10.0.0.210 () {68 vars in 1394 bytes} [Sun Apr 23 03:58:44 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 23 03:58:46 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi [req-feafc0ca-b684-4e9f-8918-eb00570589f1 req-fa23f4c8-1b0b-4008-9c37-9c15435e1459 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27abe5af-8845-40e6-a9c3-12399369b117", "name": "network-vif-plugged", "status": "completed", "tag": "85c6dc8b-d8a7-4df1-a8a5-667f7d80e42d"}, {"server_uuid": "27abe5af-8845-40e6-a9c3-12399369b117", "name": "network-vif-plugged", "status": "completed", "tag": "85c6dc8b-d8a7-4df1-a8a5-667f7d80e42d"}, {"server_uuid": "7d5ef4db-70d7-4545-9ddb-92ecdf4ebb23", "name": "network-vif-plugged", "status": "completed", "tag": "c79b33fd-e966-4247-a5e7-3b6ee20d635c"}, {"server_uuid": "7d5ef4db-70d7-4545-9ddb-92ecdf4ebb23", "name": "network-vif-plugged", "status": "completed", "tag": "c79b33fd-e966-4247-a5e7-3b6ee20d635c"}]} {{(pid=61307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 03:58:46 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [req-feafc0ca-b684-4e9f-8918-eb00570589f1 req-fa23f4c8-1b0b-4008-9c37-9c15435e1459 service nova] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:58:46 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [req-feafc0ca-b684-4e9f-8918-eb00570589f1 req-fa23f4c8-1b0b-4008-9c37-9c15435e1459 service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:58:46 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [req-feafc0ca-b684-4e9f-8918-eb00570589f1 req-fa23f4c8-1b0b-4008-9c37-9c15435e1459 service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:58:46 user devstack@n-api.service[61307]: INFO nova.api.openstack.compute.server_external_events [req-feafc0ca-b684-4e9f-8918-eb00570589f1 req-fa23f4c8-1b0b-4008-9c37-9c15435e1459 service nova] Creating event network-vif-plugged:85c6dc8b-d8a7-4df1-a8a5-667f7d80e42d for instance 27abe5af-8845-40e6-a9c3-12399369b117 on user Apr 23 03:58:46 user devstack@n-api.service[61307]: INFO nova.api.openstack.compute.server_external_events [req-feafc0ca-b684-4e9f-8918-eb00570589f1 req-fa23f4c8-1b0b-4008-9c37-9c15435e1459 service nova] Creating event network-vif-plugged:85c6dc8b-d8a7-4df1-a8a5-667f7d80e42d for instance 27abe5af-8845-40e6-a9c3-12399369b117 on user Apr 23 03:58:46 user devstack@n-api.service[61307]: INFO nova.api.openstack.compute.server_external_events [req-feafc0ca-b684-4e9f-8918-eb00570589f1 req-fa23f4c8-1b0b-4008-9c37-9c15435e1459 service nova] Creating event network-vif-plugged:c79b33fd-e966-4247-a5e7-3b6ee20d635c for instance 7d5ef4db-70d7-4545-9ddb-92ecdf4ebb23 on user Apr 23 03:58:46 user devstack@n-api.service[61307]: INFO nova.api.openstack.compute.server_external_events [req-feafc0ca-b684-4e9f-8918-eb00570589f1 req-fa23f4c8-1b0b-4008-9c37-9c15435e1459 service nova] Creating event network-vif-plugged:c79b33fd-e966-4247-a5e7-3b6ee20d635c for instance 7d5ef4db-70d7-4545-9ddb-92ecdf4ebb23 on user Apr 23 03:58:46 user devstack@n-api.service[61307]: INFO nova.api.openstack.requestlog [req-feafc0ca-b684-4e9f-8918-eb00570589f1 req-fa23f4c8-1b0b-4008-9c37-9c15435e1459 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.036351 Apr 23 03:58:46 user devstack@n-api.service[61307]: [pid: 61307|app: 0|req: 124/372] 10.0.0.210 () {68 vars in 1394 bytes} [Sun Apr 23 03:58:46 2023] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 23 03:59:01 user devstack@n-api.service[61308]: DEBUG dbcounter [-] [61308] Writing DB stats nova_cell0:SELECT=2 {{(pid=61308) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:59:01 user devstack@n-api.service[61308]: DEBUG dbcounter [-] [61308] Writing DB stats nova_api:SELECT=6 {{(pid=61308) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:59:01 user devstack@n-api.service[61308]: DEBUG dbcounter [-] [61308] Writing DB stats nova_cell1:SELECT=2 {{(pid=61308) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:59:01 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi [None req-7b862516-57e5-42c0-9212-cd52cc9ea1e2 tempest-ServersNegativeTestJSON-1115615559 tempest-ServersNegativeTestJSON-1115615559-project-member] Calling method '>' {{(pid=61308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 03:59:01 user devstack@n-api.service[61308]: DEBUG nova.compute.api [None req-7b862516-57e5-42c0-9212-cd52cc9ea1e2 tempest-ServersNegativeTestJSON-1115615559 tempest-ServersNegativeTestJSON-1115615559-project-member] [instance: 994da665-4a5f-41ce-a104-febce8be2557] Fetching instance by UUID {{(pid=61308) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 23 03:59:02 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-7b862516-57e5-42c0-9212-cd52cc9ea1e2 tempest-ServersNegativeTestJSON-1115615559 tempest-ServersNegativeTestJSON-1115615559-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:59:02 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-7b862516-57e5-42c0-9212-cd52cc9ea1e2 tempest-ServersNegativeTestJSON-1115615559 tempest-ServersNegativeTestJSON-1115615559-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:59:02 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-7b862516-57e5-42c0-9212-cd52cc9ea1e2 tempest-ServersNegativeTestJSON-1115615559 tempest-ServersNegativeTestJSON-1115615559-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:59:02 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-7b862516-57e5-42c0-9212-cd52cc9ea1e2 tempest-ServersNegativeTestJSON-1115615559 tempest-ServersNegativeTestJSON-1115615559-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:59:02 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-7b862516-57e5-42c0-9212-cd52cc9ea1e2 tempest-ServersNegativeTestJSON-1115615559 tempest-ServersNegativeTestJSON-1115615559-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:59:02 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-7b862516-57e5-42c0-9212-cd52cc9ea1e2 tempest-ServersNegativeTestJSON-1115615559 tempest-ServersNegativeTestJSON-1115615559-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:59:02 user devstack@n-api.service[61308]: DEBUG nova.policy [None req-7b862516-57e5-42c0-9212-cd52cc9ea1e2 tempest-ServersNegativeTestJSON-1115615559 tempest-ServersNegativeTestJSON-1115615559-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d9ae4a3b00492fa2fc16a22a34df09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39d6cb4cfcb2413f8039ee9febf1c046', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61308) authorize /opt/stack/nova/nova/policy.py:203}} Apr 23 03:59:02 user devstack@n-api.service[61308]: INFO nova.api.openstack.requestlog [None req-7b862516-57e5-42c0-9212-cd52cc9ea1e2 tempest-ServersNegativeTestJSON-1115615559 tempest-ServersNegativeTestJSON-1115615559-project-member] 10.0.0.210 "GET /compute/v2.1/servers/994da665-4a5f-41ce-a104-febce8be2557" status: 200 len: 1494 microversion: 2.1 time: 0.213039 Apr 23 03:59:02 user devstack@n-api.service[61308]: [pid: 61308|app: 0|req: 127/373] 10.0.0.210 () {62 vars in 1313 bytes} [Sun Apr 23 03:59:01 2023] GET /compute/v2.1/servers/994da665-4a5f-41ce-a104-febce8be2557 => generated 1494 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 23 03:59:30 user devstack@n-api.service[61306]: DEBUG dbcounter [-] [61306] Writing DB stats nova_cell0:SELECT=2 {{(pid=61306) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:59:30 user devstack@n-api.service[61306]: DEBUG dbcounter [-] [61306] Writing DB stats nova_cell0:SELECT=6 {{(pid=61306) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:59:30 user devstack@n-api.service[61306]: DEBUG dbcounter [-] [61306] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=3 {{(pid=61306) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:59:30 user devstack@n-api.service[61306]: DEBUG dbcounter [-] [61306] Writing DB stats nova_cell1:SELECT=4 {{(pid=61306) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 03:59:30 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi [None req-0b1bd493-24e2-4735-8743-146b99058644 tempest-ServerRescueNegativeTestJSON-509507797 tempest-ServerRescueNegativeTestJSON-509507797-project-member] Calling method '>' {{(pid=61306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 03:59:30 user devstack@n-api.service[61306]: DEBUG nova.compute.api [None req-0b1bd493-24e2-4735-8743-146b99058644 tempest-ServerRescueNegativeTestJSON-509507797 tempest-ServerRescueNegativeTestJSON-509507797-project-member] [instance: 7d5ef4db-70d7-4545-9ddb-92ecdf4ebb23] Fetching instance by UUID {{(pid=61306) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 23 03:59:30 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-0b1bd493-24e2-4735-8743-146b99058644 tempest-ServerRescueNegativeTestJSON-509507797 tempest-ServerRescueNegativeTestJSON-509507797-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:59:30 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-0b1bd493-24e2-4735-8743-146b99058644 tempest-ServerRescueNegativeTestJSON-509507797 tempest-ServerRescueNegativeTestJSON-509507797-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:59:30 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-0b1bd493-24e2-4735-8743-146b99058644 tempest-ServerRescueNegativeTestJSON-509507797 tempest-ServerRescueNegativeTestJSON-509507797-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:59:30 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-0b1bd493-24e2-4735-8743-146b99058644 tempest-ServerRescueNegativeTestJSON-509507797 tempest-ServerRescueNegativeTestJSON-509507797-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 03:59:30 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-0b1bd493-24e2-4735-8743-146b99058644 tempest-ServerRescueNegativeTestJSON-509507797 tempest-ServerRescueNegativeTestJSON-509507797-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 03:59:30 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-0b1bd493-24e2-4735-8743-146b99058644 tempest-ServerRescueNegativeTestJSON-509507797 tempest-ServerRescueNegativeTestJSON-509507797-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 03:59:30 user devstack@n-api.service[61306]: DEBUG nova.policy [None req-0b1bd493-24e2-4735-8743-146b99058644 tempest-ServerRescueNegativeTestJSON-509507797 tempest-ServerRescueNegativeTestJSON-509507797-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b2f522c7164c5c934b8bbf113b542a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db4b7bdc478946e2ad0a2060b433b42c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61306) authorize /opt/stack/nova/nova/policy.py:203}} Apr 23 03:59:31 user devstack@n-api.service[61306]: INFO nova.api.openstack.requestlog [None req-0b1bd493-24e2-4735-8743-146b99058644 tempest-ServerRescueNegativeTestJSON-509507797 tempest-ServerRescueNegativeTestJSON-509507797-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7d5ef4db-70d7-4545-9ddb-92ecdf4ebb23" status: 200 len: 1504 microversion: 2.1 time: 0.301889 Apr 23 03:59:31 user devstack@n-api.service[61306]: [pid: 61306|app: 0|req: 123/374] 10.0.0.210 () {62 vars in 1313 bytes} [Sun Apr 23 03:59:30 2023] GET /compute/v2.1/servers/7d5ef4db-70d7-4545-9ddb-92ecdf4ebb23 => generated 1504 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 23 04:00:02 user devstack@n-api.service[61307]: DEBUG dbcounter [-] [61307] Writing DB stats nova_cell0:SELECT=2 {{(pid=61307) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 04:00:02 user devstack@n-api.service[61307]: DEBUG dbcounter [-] [61307] Writing DB stats nova_cell0:SELECT=8 {{(pid=61307) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 04:00:02 user devstack@n-api.service[61307]: DEBUG dbcounter [-] [61307] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=3 {{(pid=61307) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 04:00:02 user devstack@n-api.service[61307]: DEBUG dbcounter [-] [61307] Writing DB stats nova_cell1:SELECT=4 {{(pid=61307) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 04:00:02 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi [None req-4c42b6aa-59d4-4d14-b7c5-040e6b42b7c9 tempest-ServersNegativeTestJSON-1115615559 tempest-ServersNegativeTestJSON-1115615559-project-member] Calling method '>' {{(pid=61307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 04:00:02 user devstack@n-api.service[61307]: DEBUG nova.compute.api [None req-4c42b6aa-59d4-4d14-b7c5-040e6b42b7c9 tempest-ServersNegativeTestJSON-1115615559 tempest-ServersNegativeTestJSON-1115615559-project-member] [instance: 994da665-4a5f-41ce-a104-febce8be2557] Fetching instance by UUID {{(pid=61307) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 23 04:00:02 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-4c42b6aa-59d4-4d14-b7c5-040e6b42b7c9 tempest-ServersNegativeTestJSON-1115615559 tempest-ServersNegativeTestJSON-1115615559-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 04:00:02 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-4c42b6aa-59d4-4d14-b7c5-040e6b42b7c9 tempest-ServersNegativeTestJSON-1115615559 tempest-ServersNegativeTestJSON-1115615559-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 04:00:02 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-4c42b6aa-59d4-4d14-b7c5-040e6b42b7c9 tempest-ServersNegativeTestJSON-1115615559 tempest-ServersNegativeTestJSON-1115615559-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 04:00:02 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-4c42b6aa-59d4-4d14-b7c5-040e6b42b7c9 tempest-ServersNegativeTestJSON-1115615559 tempest-ServersNegativeTestJSON-1115615559-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 04:00:02 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-4c42b6aa-59d4-4d14-b7c5-040e6b42b7c9 tempest-ServersNegativeTestJSON-1115615559 tempest-ServersNegativeTestJSON-1115615559-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 04:00:02 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-4c42b6aa-59d4-4d14-b7c5-040e6b42b7c9 tempest-ServersNegativeTestJSON-1115615559 tempest-ServersNegativeTestJSON-1115615559-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 04:00:02 user devstack@n-api.service[61307]: DEBUG nova.compute.api [None req-4c42b6aa-59d4-4d14-b7c5-040e6b42b7c9 tempest-ServersNegativeTestJSON-1115615559 tempest-ServersNegativeTestJSON-1115615559-project-member] [instance: 994da665-4a5f-41ce-a104-febce8be2557] Going to try to terminate instance {{(pid=61307) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 23 04:00:02 user devstack@n-api.service[61307]: INFO nova.api.openstack.requestlog [None req-4c42b6aa-59d4-4d14-b7c5-040e6b42b7c9 tempest-ServersNegativeTestJSON-1115615559 tempest-ServersNegativeTestJSON-1115615559-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/994da665-4a5f-41ce-a104-febce8be2557" status: 204 len: 0 microversion: 2.1 time: 0.228433 Apr 23 04:00:02 user devstack@n-api.service[61307]: [pid: 61307|app: 0|req: 125/375] 10.0.0.210 () {62 vars in 1316 bytes} [Sun Apr 23 04:00:02 2023] DELETE /compute/v2.1/servers/994da665-4a5f-41ce-a104-febce8be2557 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 23 04:00:02 user devstack@n-api.service[61308]: DEBUG dbcounter [-] [61308] Writing DB stats nova_api:SELECT=2 {{(pid=61308) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 04:00:02 user devstack@n-api.service[61308]: DEBUG dbcounter [-] [61308] Writing DB stats nova_cell1:SELECT=6 {{(pid=61308) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 04:00:02 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi [None req-883d172d-7baa-48e3-a63d-867eccf7ea71 tempest-ServersNegativeTestJSON-1115615559 tempest-ServersNegativeTestJSON-1115615559-project-member] Calling method '>' {{(pid=61308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 04:00:02 user devstack@n-api.service[61308]: DEBUG nova.compute.api [None req-883d172d-7baa-48e3-a63d-867eccf7ea71 tempest-ServersNegativeTestJSON-1115615559 tempest-ServersNegativeTestJSON-1115615559-project-member] [instance: 994da665-4a5f-41ce-a104-febce8be2557] Fetching instance by UUID {{(pid=61308) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 23 04:00:02 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-883d172d-7baa-48e3-a63d-867eccf7ea71 tempest-ServersNegativeTestJSON-1115615559 tempest-ServersNegativeTestJSON-1115615559-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 04:00:02 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-883d172d-7baa-48e3-a63d-867eccf7ea71 tempest-ServersNegativeTestJSON-1115615559 tempest-ServersNegativeTestJSON-1115615559-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 04:00:02 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-883d172d-7baa-48e3-a63d-867eccf7ea71 tempest-ServersNegativeTestJSON-1115615559 tempest-ServersNegativeTestJSON-1115615559-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 04:00:02 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-883d172d-7baa-48e3-a63d-867eccf7ea71 tempest-ServersNegativeTestJSON-1115615559 tempest-ServersNegativeTestJSON-1115615559-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 04:00:02 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-883d172d-7baa-48e3-a63d-867eccf7ea71 tempest-ServersNegativeTestJSON-1115615559 tempest-ServersNegativeTestJSON-1115615559-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 04:00:02 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-883d172d-7baa-48e3-a63d-867eccf7ea71 tempest-ServersNegativeTestJSON-1115615559 tempest-ServersNegativeTestJSON-1115615559-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 04:00:02 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi [req-f72379ae-f69c-4925-93dd-8d4fb5dec352 req-022c9255-5510-413f-9c18-dc1df5e83281 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "994da665-4a5f-41ce-a104-febce8be2557", "name": "network-vif-unplugged", "status": "completed", "tag": "7f5011fe-2339-41ec-b6db-535375a33a9d"}]} {{(pid=61306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 04:00:02 user devstack@n-api.service[61306]: DEBUG dbcounter [-] [61306] Writing DB stats nova_api:SELECT=2 {{(pid=61306) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 04:00:02 user devstack@n-api.service[61306]: DEBUG dbcounter [-] [61306] Writing DB stats nova_cell1:SELECT=6 {{(pid=61306) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 04:00:02 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [req-f72379ae-f69c-4925-93dd-8d4fb5dec352 req-022c9255-5510-413f-9c18-dc1df5e83281 service nova] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 04:00:02 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [req-f72379ae-f69c-4925-93dd-8d4fb5dec352 req-022c9255-5510-413f-9c18-dc1df5e83281 service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 04:00:02 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [req-f72379ae-f69c-4925-93dd-8d4fb5dec352 req-022c9255-5510-413f-9c18-dc1df5e83281 service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 04:00:02 user devstack@n-api.service[61306]: INFO nova.api.openstack.compute.server_external_events [req-f72379ae-f69c-4925-93dd-8d4fb5dec352 req-022c9255-5510-413f-9c18-dc1df5e83281 service nova] Creating event network-vif-unplugged:7f5011fe-2339-41ec-b6db-535375a33a9d for instance 994da665-4a5f-41ce-a104-febce8be2557 on user Apr 23 04:00:02 user devstack@n-api.service[61306]: INFO nova.api.openstack.requestlog [req-f72379ae-f69c-4925-93dd-8d4fb5dec352 req-022c9255-5510-413f-9c18-dc1df5e83281 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042636 Apr 23 04:00:02 user devstack@n-api.service[61306]: [pid: 61306|app: 0|req: 124/376] 10.0.0.210 () {68 vars in 1394 bytes} [Sun Apr 23 04:00:02 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 23 04:00:02 user devstack@n-api.service[61308]: DEBUG nova.policy [None req-883d172d-7baa-48e3-a63d-867eccf7ea71 tempest-ServersNegativeTestJSON-1115615559 tempest-ServersNegativeTestJSON-1115615559-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d9ae4a3b00492fa2fc16a22a34df09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39d6cb4cfcb2413f8039ee9febf1c046', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61308) authorize /opt/stack/nova/nova/policy.py:203}} Apr 23 04:00:02 user devstack@n-api.service[61308]: INFO nova.api.openstack.requestlog [None req-883d172d-7baa-48e3-a63d-867eccf7ea71 tempest-ServersNegativeTestJSON-1115615559 tempest-ServersNegativeTestJSON-1115615559-project-member] 10.0.0.210 "GET /compute/v2.1/servers/994da665-4a5f-41ce-a104-febce8be2557" status: 200 len: 1500 microversion: 2.1 time: 0.397331 Apr 23 04:00:02 user devstack@n-api.service[61308]: [pid: 61308|app: 0|req: 128/377] 10.0.0.210 () {62 vars in 1313 bytes} [Sun Apr 23 04:00:02 2023] GET /compute/v2.1/servers/994da665-4a5f-41ce-a104-febce8be2557 => generated 1500 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 23 04:00:03 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi [req-e3b61cc2-896e-4ad9-a2c3-ee7c9487bb19 req-e4471c33-6b15-495c-b621-1394176b0837 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "994da665-4a5f-41ce-a104-febce8be2557", "name": "network-vif-deleted", "tag": "7f5011fe-2339-41ec-b6db-535375a33a9d"}]} {{(pid=61307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 04:00:03 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [req-e3b61cc2-896e-4ad9-a2c3-ee7c9487bb19 req-e4471c33-6b15-495c-b621-1394176b0837 service nova] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 04:00:03 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [req-e3b61cc2-896e-4ad9-a2c3-ee7c9487bb19 req-e4471c33-6b15-495c-b621-1394176b0837 service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 04:00:03 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [req-e3b61cc2-896e-4ad9-a2c3-ee7c9487bb19 req-e4471c33-6b15-495c-b621-1394176b0837 service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 04:00:03 user devstack@n-api.service[61307]: INFO nova.api.openstack.compute.server_external_events [req-e3b61cc2-896e-4ad9-a2c3-ee7c9487bb19 req-e4471c33-6b15-495c-b621-1394176b0837 service nova] Creating event network-vif-deleted:7f5011fe-2339-41ec-b6db-535375a33a9d for instance 994da665-4a5f-41ce-a104-febce8be2557 on user Apr 23 04:00:03 user devstack@n-api.service[61307]: INFO nova.api.openstack.requestlog [req-e3b61cc2-896e-4ad9-a2c3-ee7c9487bb19 req-e4471c33-6b15-495c-b621-1394176b0837 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033978 Apr 23 04:00:03 user devstack@n-api.service[61307]: [pid: 61307|app: 0|req: 126/378] 10.0.0.210 () {68 vars in 1394 bytes} [Sun Apr 23 04:00:03 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 23 04:00:04 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi [req-10bb6a6f-4835-40ec-a50a-6fa8fe85bf37 req-f94f2ea2-7c8f-48be-a909-ec0003ddd1a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "994da665-4a5f-41ce-a104-febce8be2557", "name": "network-vif-plugged", "status": "completed", "tag": "7f5011fe-2339-41ec-b6db-535375a33a9d"}]} {{(pid=61306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 04:00:04 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [req-10bb6a6f-4835-40ec-a50a-6fa8fe85bf37 req-f94f2ea2-7c8f-48be-a909-ec0003ddd1a9 service nova] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 04:00:04 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [req-10bb6a6f-4835-40ec-a50a-6fa8fe85bf37 req-f94f2ea2-7c8f-48be-a909-ec0003ddd1a9 service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 04:00:04 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [req-10bb6a6f-4835-40ec-a50a-6fa8fe85bf37 req-f94f2ea2-7c8f-48be-a909-ec0003ddd1a9 service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 04:00:04 user devstack@n-api.service[61306]: INFO nova.api.openstack.compute.server_external_events [req-10bb6a6f-4835-40ec-a50a-6fa8fe85bf37 req-f94f2ea2-7c8f-48be-a909-ec0003ddd1a9 service nova] Creating event network-vif-plugged:7f5011fe-2339-41ec-b6db-535375a33a9d for instance 994da665-4a5f-41ce-a104-febce8be2557 on user Apr 23 04:00:04 user devstack@n-api.service[61306]: INFO nova.api.openstack.requestlog [req-10bb6a6f-4835-40ec-a50a-6fa8fe85bf37 req-f94f2ea2-7c8f-48be-a909-ec0003ddd1a9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032536 Apr 23 04:00:04 user devstack@n-api.service[61306]: [pid: 61306|app: 0|req: 125/379] 10.0.0.210 () {68 vars in 1394 bytes} [Sun Apr 23 04:00:04 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 23 04:00:31 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi [None req-813f3336-1227-462e-bd19-550c1f314b09 tempest-ServerRescueNegativeTestJSON-509507797 tempest-ServerRescueNegativeTestJSON-509507797-project-member] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=61308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 04:00:31 user devstack@n-api.service[61308]: DEBUG nova.compute.api [None req-813f3336-1227-462e-bd19-550c1f314b09 tempest-ServerRescueNegativeTestJSON-509507797 tempest-ServerRescueNegativeTestJSON-509507797-project-member] [instance: 7d5ef4db-70d7-4545-9ddb-92ecdf4ebb23] Fetching instance by UUID {{(pid=61308) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 23 04:00:31 user devstack@n-api.service[61308]: DEBUG dbcounter [-] [61308] Writing DB stats nova_api:SELECT=2 {{(pid=61308) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 04:00:31 user devstack@n-api.service[61308]: DEBUG dbcounter [-] [61308] Writing DB stats nova_cell1:SELECT=6 {{(pid=61308) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 04:00:31 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-813f3336-1227-462e-bd19-550c1f314b09 tempest-ServerRescueNegativeTestJSON-509507797 tempest-ServerRescueNegativeTestJSON-509507797-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 04:00:31 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-813f3336-1227-462e-bd19-550c1f314b09 tempest-ServerRescueNegativeTestJSON-509507797 tempest-ServerRescueNegativeTestJSON-509507797-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 04:00:31 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-813f3336-1227-462e-bd19-550c1f314b09 tempest-ServerRescueNegativeTestJSON-509507797 tempest-ServerRescueNegativeTestJSON-509507797-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 04:00:31 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-813f3336-1227-462e-bd19-550c1f314b09 tempest-ServerRescueNegativeTestJSON-509507797 tempest-ServerRescueNegativeTestJSON-509507797-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 04:00:31 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-813f3336-1227-462e-bd19-550c1f314b09 tempest-ServerRescueNegativeTestJSON-509507797 tempest-ServerRescueNegativeTestJSON-509507797-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 04:00:31 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-813f3336-1227-462e-bd19-550c1f314b09 tempest-ServerRescueNegativeTestJSON-509507797 tempest-ServerRescueNegativeTestJSON-509507797-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 04:00:31 user devstack@n-api.service[61308]: DEBUG nova.objects.instance [None req-813f3336-1227-462e-bd19-550c1f314b09 tempest-ServerRescueNegativeTestJSON-509507797 tempest-ServerRescueNegativeTestJSON-509507797-project-member] Lazy-loading 'flavor' on Instance uuid 7d5ef4db-70d7-4545-9ddb-92ecdf4ebb23 {{(pid=61308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 23 04:00:31 user devstack@n-api.service[61308]: INFO nova.api.openstack.requestlog [None req-813f3336-1227-462e-bd19-550c1f314b09 tempest-ServerRescueNegativeTestJSON-509507797 tempest-ServerRescueNegativeTestJSON-509507797-project-member] 10.0.0.210 "POST /compute/v2.1/servers/7d5ef4db-70d7-4545-9ddb-92ecdf4ebb23/action" status: 200 len: 32 microversion: 2.1 time: 0.138924 Apr 23 04:00:31 user devstack@n-api.service[61308]: [pid: 61308|app: 0|req: 129/380] 10.0.0.210 () {64 vars in 1355 bytes} [Sun Apr 23 04:00:31 2023] POST /compute/v2.1/servers/7d5ef4db-70d7-4545-9ddb-92ecdf4ebb23/action => generated 32 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Apr 23 04:00:31 user devstack@n-api.service[61307]: DEBUG dbcounter [-] [61307] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61307) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 04:00:31 user devstack@n-api.service[61307]: DEBUG dbcounter [-] [61307] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61307) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 04:00:31 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi [None req-439a90ba-9b7e-4294-9240-4005dd6e896b tempest-ServerRescueNegativeTestJSON-509507797 tempest-ServerRescueNegativeTestJSON-509507797-project-member] Calling method '>' {{(pid=61307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 04:00:31 user devstack@n-api.service[61307]: DEBUG nova.compute.api [None req-439a90ba-9b7e-4294-9240-4005dd6e896b tempest-ServerRescueNegativeTestJSON-509507797 tempest-ServerRescueNegativeTestJSON-509507797-project-member] [instance: 7d5ef4db-70d7-4545-9ddb-92ecdf4ebb23] Fetching instance by UUID {{(pid=61307) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 23 04:00:31 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-439a90ba-9b7e-4294-9240-4005dd6e896b tempest-ServerRescueNegativeTestJSON-509507797 tempest-ServerRescueNegativeTestJSON-509507797-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 04:00:31 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-439a90ba-9b7e-4294-9240-4005dd6e896b tempest-ServerRescueNegativeTestJSON-509507797 tempest-ServerRescueNegativeTestJSON-509507797-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 04:00:31 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-439a90ba-9b7e-4294-9240-4005dd6e896b tempest-ServerRescueNegativeTestJSON-509507797 tempest-ServerRescueNegativeTestJSON-509507797-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 04:00:31 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-439a90ba-9b7e-4294-9240-4005dd6e896b tempest-ServerRescueNegativeTestJSON-509507797 tempest-ServerRescueNegativeTestJSON-509507797-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 04:00:31 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-439a90ba-9b7e-4294-9240-4005dd6e896b tempest-ServerRescueNegativeTestJSON-509507797 tempest-ServerRescueNegativeTestJSON-509507797-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 04:00:31 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-439a90ba-9b7e-4294-9240-4005dd6e896b tempest-ServerRescueNegativeTestJSON-509507797 tempest-ServerRescueNegativeTestJSON-509507797-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 04:00:31 user devstack@n-api.service[61307]: DEBUG nova.policy [None req-439a90ba-9b7e-4294-9240-4005dd6e896b tempest-ServerRescueNegativeTestJSON-509507797 tempest-ServerRescueNegativeTestJSON-509507797-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b2f522c7164c5c934b8bbf113b542a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db4b7bdc478946e2ad0a2060b433b42c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61307) authorize /opt/stack/nova/nova/policy.py:203}} Apr 23 04:00:31 user devstack@n-api.service[61307]: INFO nova.api.openstack.requestlog [None req-439a90ba-9b7e-4294-9240-4005dd6e896b tempest-ServerRescueNegativeTestJSON-509507797 tempest-ServerRescueNegativeTestJSON-509507797-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7d5ef4db-70d7-4545-9ddb-92ecdf4ebb23" status: 200 len: 1510 microversion: 2.1 time: 0.235892 Apr 23 04:00:31 user devstack@n-api.service[61307]: [pid: 61307|app: 0|req: 127/381] 10.0.0.210 () {62 vars in 1313 bytes} [Sun Apr 23 04:00:31 2023] GET /compute/v2.1/servers/7d5ef4db-70d7-4545-9ddb-92ecdf4ebb23 => generated 1510 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 23 04:00:31 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi [req-eb7f6342-1844-4f92-b064-5b59f7784ced req-f9df2113-fdca-4e03-a6e8-c31c9279d5bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d5ef4db-70d7-4545-9ddb-92ecdf4ebb23", "name": "network-vif-unplugged", "status": "completed", "tag": "c79b33fd-e966-4247-a5e7-3b6ee20d635c"}]} {{(pid=61306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 04:00:31 user devstack@n-api.service[61306]: DEBUG dbcounter [-] [61306] Writing DB stats nova_api:SELECT=4 {{(pid=61306) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 04:00:31 user devstack@n-api.service[61306]: DEBUG dbcounter [-] [61306] Writing DB stats nova_cell1:SELECT=4 {{(pid=61306) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 04:00:31 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [req-eb7f6342-1844-4f92-b064-5b59f7784ced req-f9df2113-fdca-4e03-a6e8-c31c9279d5bb service nova] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 04:00:31 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [req-eb7f6342-1844-4f92-b064-5b59f7784ced req-f9df2113-fdca-4e03-a6e8-c31c9279d5bb service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 04:00:31 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [req-eb7f6342-1844-4f92-b064-5b59f7784ced req-f9df2113-fdca-4e03-a6e8-c31c9279d5bb service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 04:00:32 user devstack@n-api.service[61306]: INFO nova.api.openstack.compute.server_external_events [req-eb7f6342-1844-4f92-b064-5b59f7784ced req-f9df2113-fdca-4e03-a6e8-c31c9279d5bb service nova] Creating event network-vif-unplugged:c79b33fd-e966-4247-a5e7-3b6ee20d635c for instance 7d5ef4db-70d7-4545-9ddb-92ecdf4ebb23 on user Apr 23 04:00:32 user devstack@n-api.service[61306]: INFO nova.api.openstack.requestlog [req-eb7f6342-1844-4f92-b064-5b59f7784ced req-f9df2113-fdca-4e03-a6e8-c31c9279d5bb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036931 Apr 23 04:00:32 user devstack@n-api.service[61306]: [pid: 61306|app: 0|req: 126/382] 10.0.0.210 () {68 vars in 1394 bytes} [Sun Apr 23 04:00:31 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 23 04:00:34 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi [req-bb813bb9-dd53-4b64-9be3-ebe252942470 req-db000270-ac57-4f4c-b929-d26cb25678fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d5ef4db-70d7-4545-9ddb-92ecdf4ebb23", "name": "network-vif-plugged", "status": "completed", "tag": "c79b33fd-e966-4247-a5e7-3b6ee20d635c"}]} {{(pid=61308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 04:00:34 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [req-bb813bb9-dd53-4b64-9be3-ebe252942470 req-db000270-ac57-4f4c-b929-d26cb25678fe service nova] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 04:00:34 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [req-bb813bb9-dd53-4b64-9be3-ebe252942470 req-db000270-ac57-4f4c-b929-d26cb25678fe service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 04:00:34 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [req-bb813bb9-dd53-4b64-9be3-ebe252942470 req-db000270-ac57-4f4c-b929-d26cb25678fe service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 04:00:34 user devstack@n-api.service[61308]: INFO nova.api.openstack.compute.server_external_events [req-bb813bb9-dd53-4b64-9be3-ebe252942470 req-db000270-ac57-4f4c-b929-d26cb25678fe service nova] Creating event network-vif-plugged:c79b33fd-e966-4247-a5e7-3b6ee20d635c for instance 7d5ef4db-70d7-4545-9ddb-92ecdf4ebb23 on user Apr 23 04:00:34 user devstack@n-api.service[61308]: INFO nova.api.openstack.requestlog [req-bb813bb9-dd53-4b64-9be3-ebe252942470 req-db000270-ac57-4f4c-b929-d26cb25678fe service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029232 Apr 23 04:00:34 user devstack@n-api.service[61308]: [pid: 61308|app: 0|req: 130/383] 10.0.0.210 () {68 vars in 1394 bytes} [Sun Apr 23 04:00:34 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 23 04:00:36 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi [req-20f7ae2f-e649-471f-9592-f00a6d3f00c8 req-59500b07-e64a-46e7-a58f-c7d85bd5757f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d5ef4db-70d7-4545-9ddb-92ecdf4ebb23", "name": "network-vif-plugged", "status": "completed", "tag": "c79b33fd-e966-4247-a5e7-3b6ee20d635c"}, {"server_uuid": "7d5ef4db-70d7-4545-9ddb-92ecdf4ebb23", "name": "network-vif-plugged", "status": "completed", "tag": "c79b33fd-e966-4247-a5e7-3b6ee20d635c"}]} {{(pid=61307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 04:00:36 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [req-20f7ae2f-e649-471f-9592-f00a6d3f00c8 req-59500b07-e64a-46e7-a58f-c7d85bd5757f service nova] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 04:00:36 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [req-20f7ae2f-e649-471f-9592-f00a6d3f00c8 req-59500b07-e64a-46e7-a58f-c7d85bd5757f service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 04:00:36 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [req-20f7ae2f-e649-471f-9592-f00a6d3f00c8 req-59500b07-e64a-46e7-a58f-c7d85bd5757f service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 04:00:36 user devstack@n-api.service[61307]: INFO nova.api.openstack.compute.server_external_events [req-20f7ae2f-e649-471f-9592-f00a6d3f00c8 req-59500b07-e64a-46e7-a58f-c7d85bd5757f service nova] Creating event network-vif-plugged:c79b33fd-e966-4247-a5e7-3b6ee20d635c for instance 7d5ef4db-70d7-4545-9ddb-92ecdf4ebb23 on user Apr 23 04:00:36 user devstack@n-api.service[61307]: INFO nova.api.openstack.compute.server_external_events [req-20f7ae2f-e649-471f-9592-f00a6d3f00c8 req-59500b07-e64a-46e7-a58f-c7d85bd5757f service nova] Creating event network-vif-plugged:c79b33fd-e966-4247-a5e7-3b6ee20d635c for instance 7d5ef4db-70d7-4545-9ddb-92ecdf4ebb23 on user Apr 23 04:00:36 user devstack@n-api.service[61307]: INFO nova.api.openstack.requestlog [req-20f7ae2f-e649-471f-9592-f00a6d3f00c8 req-59500b07-e64a-46e7-a58f-c7d85bd5757f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.031780 Apr 23 04:00:36 user devstack@n-api.service[61307]: [pid: 61307|app: 0|req: 128/384] 10.0.0.210 () {68 vars in 1394 bytes} [Sun Apr 23 04:00:36 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 23 04:00:52 user devstack@n-api.service[61306]: DEBUG dbcounter [-] [61306] Writing DB stats nova_api:SELECT=2 {{(pid=61306) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 04:00:52 user devstack@n-api.service[61306]: DEBUG dbcounter [-] [61306] Writing DB stats nova_cell1:SELECT=2 {{(pid=61306) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 04:00:52 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi [None req-51c332ad-64de-495e-919d-1a86ad696515 tempest-ServersNegativeTestJSON-1115615559 tempest-ServersNegativeTestJSON-1115615559-project-member] Calling method '>' {{(pid=61306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 04:00:52 user devstack@n-api.service[61306]: DEBUG nova.compute.api [None req-51c332ad-64de-495e-919d-1a86ad696515 tempest-ServersNegativeTestJSON-1115615559 tempest-ServersNegativeTestJSON-1115615559-project-member] [instance: 994da665-4a5f-41ce-a104-febce8be2557] Fetching instance by UUID {{(pid=61306) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 23 04:00:52 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-51c332ad-64de-495e-919d-1a86ad696515 tempest-ServersNegativeTestJSON-1115615559 tempest-ServersNegativeTestJSON-1115615559-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 04:00:52 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-51c332ad-64de-495e-919d-1a86ad696515 tempest-ServersNegativeTestJSON-1115615559 tempest-ServersNegativeTestJSON-1115615559-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 04:00:52 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-51c332ad-64de-495e-919d-1a86ad696515 tempest-ServersNegativeTestJSON-1115615559 tempest-ServersNegativeTestJSON-1115615559-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 04:00:52 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-51c332ad-64de-495e-919d-1a86ad696515 tempest-ServersNegativeTestJSON-1115615559 tempest-ServersNegativeTestJSON-1115615559-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 04:00:52 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-51c332ad-64de-495e-919d-1a86ad696515 tempest-ServersNegativeTestJSON-1115615559 tempest-ServersNegativeTestJSON-1115615559-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 04:00:52 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-51c332ad-64de-495e-919d-1a86ad696515 tempest-ServersNegativeTestJSON-1115615559 tempest-ServersNegativeTestJSON-1115615559-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 04:00:52 user devstack@n-api.service[61306]: INFO nova.api.openstack.wsgi [None req-51c332ad-64de-495e-919d-1a86ad696515 tempest-ServersNegativeTestJSON-1115615559 tempest-ServersNegativeTestJSON-1115615559-project-member] HTTP exception thrown: Instance 994da665-4a5f-41ce-a104-febce8be2557 could not be found. Apr 23 04:00:52 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi [None req-51c332ad-64de-495e-919d-1a86ad696515 tempest-ServersNegativeTestJSON-1115615559 tempest-ServersNegativeTestJSON-1115615559-project-member] Request method failure captured: Apr 23 04:00:52 user devstack@n-api.service[61306]: request: GET /compute/v2.1/servers/994da665-4a5f-41ce-a104-febce8be2557 HTTP/1.1 Apr 23 04:00:52 user devstack@n-api.service[61306]: Accept: application/json Apr 23 04:00:52 user devstack@n-api.service[61306]: Accept-Encoding: identity Apr 23 04:00:52 user devstack@n-api.service[61306]: Connection: close Apr 23 04:00:52 user devstack@n-api.service[61306]: Content-Length: 0 Apr 23 04:00:52 user devstack@n-api.service[61306]: Content-Type: application/json Apr 23 04:00:52 user devstack@n-api.service[61306]: Host: 10.0.0.210 Apr 23 04:00:52 user devstack@n-api.service[61306]: Openstack-System-Scope: None Apr 23 04:00:52 user devstack@n-api.service[61306]: User-Agent: python-urllib3/1.26.15 Apr 23 04:00:52 user devstack@n-api.service[61306]: X-Auth-Token: gAAAAABkRKxjEhCjoNMqtLhu2RxdK5iis_mOy1m1OhYgEHq1hqZgaDN8nyVa42IgLK3MeaWhPhYnxfP3I5ZsEj0up2VGTAfJAsexVojvTvodGrsXaEkQKlVj5_rGG_Fhan4XJMitnwDyPDaY7kHeCRdEkSPEhUCq-5gRNlv5HuvOmo51IwGtFWM Apr 23 04:00:52 user devstack@n-api.service[61306]: X-Domain-Id: None Apr 23 04:00:52 user devstack@n-api.service[61306]: X-Domain-Name: None Apr 23 04:00:52 user devstack@n-api.service[61306]: X-Identity-Status: Confirmed Apr 23 04:00:52 user devstack@n-api.service[61306]: X-Is-Admin-Project: True Apr 23 04:00:52 user devstack@n-api.service[61306]: X-Project-Domain-Id: default Apr 23 04:00:52 user devstack@n-api.service[61306]: X-Project-Domain-Name: Default Apr 23 04:00:52 user devstack@n-api.service[61306]: X-Project-Id: 39d6cb4cfcb2413f8039ee9febf1c046 Apr 23 04:00:52 user devstack@n-api.service[61306]: X-Project-Name: tempest-ServersNegativeTestJSON-1115615559 Apr 23 04:00:52 user devstack@n-api.service[61306]: X-Role: reader,member Apr 23 04:00:52 user devstack@n-api.service[61306]: X-Roles: reader,member Apr 23 04:00:52 user devstack@n-api.service[61306]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/39d6cb4cfcb2413f8039ee9febf1c046"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/39d6cb4cfcb2413f8039ee9febf1c046"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/39d6cb4cfcb2413f8039ee9febf1c046"}]}] Apr 23 04:00:52 user devstack@n-api.service[61306]: X-Tenant: tempest-ServersNegativeTestJSON-1115615559 Apr 23 04:00:52 user devstack@n-api.service[61306]: X-Tenant-Id: 39d6cb4cfcb2413f8039ee9febf1c046 Apr 23 04:00:52 user devstack@n-api.service[61306]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1115615559 Apr 23 04:00:52 user devstack@n-api.service[61306]: X-User: tempest-ServersNegativeTestJSON-1115615559-project-member Apr 23 04:00:52 user devstack@n-api.service[61306]: X-User-Domain-Id: default Apr 23 04:00:52 user devstack@n-api.service[61306]: X-User-Domain-Name: Default Apr 23 04:00:52 user devstack@n-api.service[61306]: X-User-Id: 45d9ae4a3b00492fa2fc16a22a34df09 Apr 23 04:00:52 user devstack@n-api.service[61306]: X-User-Name: tempest-ServersNegativeTestJSON-1115615559-project-member Apr 23 04:00:52 user devstack@n-api.service[61306]: method: > Apr 23 04:00:52 user devstack@n-api.service[61306]: exception: Instance 994da665-4a5f-41ce-a104-febce8be2557 could not be found. Apr 23 04:00:52 user devstack@n-api.service[61306]: action_args: {'id': '994da665-4a5f-41ce-a104-febce8be2557'} Apr 23 04:00:52 user devstack@n-api.service[61306]: {{(pid=61306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 23 04:00:52 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 23 04:00:52 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 23 04:00:52 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 23 04:00:52 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 23 04:00:52 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 23 04:00:52 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 23 04:00:52 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 23 04:00:52 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 23 04:00:52 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 23 04:00:52 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 994da665-4a5f-41ce-a104-febce8be2557 could not be found. Apr 23 04:00:52 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi Apr 23 04:00:52 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 23 04:00:52 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi Apr 23 04:00:52 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 23 04:00:52 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 23 04:00:52 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 23 04:00:52 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 23 04:00:52 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 23 04:00:52 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 23 04:00:52 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 23 04:00:52 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 23 04:00:52 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 23 04:00:52 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 23 04:00:52 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 23 04:00:52 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 23 04:00:52 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 23 04:00:52 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 994da665-4a5f-41ce-a104-febce8be2557 could not be found. Apr 23 04:00:52 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi Apr 23 04:00:52 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 23 04:00:52 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi Apr 23 04:00:52 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 23 04:00:52 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 23 04:00:52 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 23 04:00:52 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 23 04:00:52 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 23 04:00:52 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 994da665-4a5f-41ce-a104-febce8be2557 could not be found. Apr 23 04:00:52 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi Apr 23 04:00:52 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi [None req-51c332ad-64de-495e-919d-1a86ad696515 tempest-ServersNegativeTestJSON-1115615559 tempest-ServersNegativeTestJSON-1115615559-project-member] Returning 404 to user: Instance 994da665-4a5f-41ce-a104-febce8be2557 could not be found. {{(pid=61306) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 23 04:00:52 user devstack@n-api.service[61306]: INFO nova.api.openstack.requestlog [None req-51c332ad-64de-495e-919d-1a86ad696515 tempest-ServersNegativeTestJSON-1115615559 tempest-ServersNegativeTestJSON-1115615559-project-member] 10.0.0.210 "GET /compute/v2.1/servers/994da665-4a5f-41ce-a104-febce8be2557" status: 404 len: 111 microversion: 2.1 time: 0.039776 Apr 23 04:00:52 user devstack@n-api.service[61306]: [pid: 61306|app: 0|req: 127/385] 10.0.0.210 () {62 vars in 1313 bytes} [Sun Apr 23 04:00:52 2023] GET /compute/v2.1/servers/994da665-4a5f-41ce-a104-febce8be2557 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 23 04:00:52 user devstack@n-api.service[61308]: DEBUG dbcounter [-] [61308] Writing DB stats nova_api:SELECT=4 {{(pid=61308) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 04:00:52 user devstack@n-api.service[61308]: DEBUG dbcounter [-] [61308] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61308) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 04:00:52 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi [None req-172575e9-bc3f-4651-8b54-49a1618f47f9 tempest-ServersNegativeTestJSON-1115615559 tempest-ServersNegativeTestJSON-1115615559-project-member] Calling method '>' {{(pid=61308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 04:00:52 user devstack@n-api.service[61308]: DEBUG nova.compute.api [None req-172575e9-bc3f-4651-8b54-49a1618f47f9 tempest-ServersNegativeTestJSON-1115615559 tempest-ServersNegativeTestJSON-1115615559-project-member] [instance: ee89a9d5-0507-475c-bea2-e02e34d15710] Fetching instance by UUID {{(pid=61308) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 23 04:00:52 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-172575e9-bc3f-4651-8b54-49a1618f47f9 tempest-ServersNegativeTestJSON-1115615559 tempest-ServersNegativeTestJSON-1115615559-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 04:00:52 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-172575e9-bc3f-4651-8b54-49a1618f47f9 tempest-ServersNegativeTestJSON-1115615559 tempest-ServersNegativeTestJSON-1115615559-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 04:00:52 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-172575e9-bc3f-4651-8b54-49a1618f47f9 tempest-ServersNegativeTestJSON-1115615559 tempest-ServersNegativeTestJSON-1115615559-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 04:00:52 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-172575e9-bc3f-4651-8b54-49a1618f47f9 tempest-ServersNegativeTestJSON-1115615559 tempest-ServersNegativeTestJSON-1115615559-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 04:00:52 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-172575e9-bc3f-4651-8b54-49a1618f47f9 tempest-ServersNegativeTestJSON-1115615559 tempest-ServersNegativeTestJSON-1115615559-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 04:00:52 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-172575e9-bc3f-4651-8b54-49a1618f47f9 tempest-ServersNegativeTestJSON-1115615559 tempest-ServersNegativeTestJSON-1115615559-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 04:00:53 user devstack@n-api.service[61308]: DEBUG nova.policy [None req-172575e9-bc3f-4651-8b54-49a1618f47f9 tempest-ServersNegativeTestJSON-1115615559 tempest-ServersNegativeTestJSON-1115615559-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d9ae4a3b00492fa2fc16a22a34df09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39d6cb4cfcb2413f8039ee9febf1c046', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61308) authorize /opt/stack/nova/nova/policy.py:203}} Apr 23 04:00:53 user devstack@n-api.service[61308]: INFO nova.api.openstack.requestlog [None req-172575e9-bc3f-4651-8b54-49a1618f47f9 tempest-ServersNegativeTestJSON-1115615559 tempest-ServersNegativeTestJSON-1115615559-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ee89a9d5-0507-475c-bea2-e02e34d15710" status: 200 len: 1495 microversion: 2.1 time: 0.229570 Apr 23 04:00:53 user devstack@n-api.service[61308]: [pid: 61308|app: 0|req: 131/386] 10.0.0.210 () {62 vars in 1313 bytes} [Sun Apr 23 04:00:52 2023] GET /compute/v2.1/servers/ee89a9d5-0507-475c-bea2-e02e34d15710 => generated 1495 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 23 04:01:21 user devstack@n-api.service[61307]: DEBUG dbcounter [-] [61307] Writing DB stats nova_api:SELECT=4 {{(pid=61307) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 04:01:21 user devstack@n-api.service[61307]: DEBUG dbcounter [-] [61307] Writing DB stats nova_cell1:SELECT=8 {{(pid=61307) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 04:01:21 user devstack@n-api.service[61307]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 23 04:01:21 user devstack@n-api.service[61307]: Sun Apr 23 04:01:21 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7d5ef4db-70d7-4545-9ddb-92ecdf4ebb23 (ip 10.0.0.210) !!! Apr 23 04:01:21 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi [None req-4236c9f1-60bc-446f-85a5-0f74244d2b3d tempest-ServerRescueNegativeTestJSON-509507797 tempest-ServerRescueNegativeTestJSON-509507797-project-member] Calling method '>' {{(pid=61307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 04:01:21 user devstack@n-api.service[61307]: DEBUG nova.compute.api [None req-4236c9f1-60bc-446f-85a5-0f74244d2b3d tempest-ServerRescueNegativeTestJSON-509507797 tempest-ServerRescueNegativeTestJSON-509507797-project-member] [instance: 7d5ef4db-70d7-4545-9ddb-92ecdf4ebb23] Fetching instance by UUID {{(pid=61307) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 23 04:01:21 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-4236c9f1-60bc-446f-85a5-0f74244d2b3d tempest-ServerRescueNegativeTestJSON-509507797 tempest-ServerRescueNegativeTestJSON-509507797-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 04:01:21 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-4236c9f1-60bc-446f-85a5-0f74244d2b3d tempest-ServerRescueNegativeTestJSON-509507797 tempest-ServerRescueNegativeTestJSON-509507797-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 04:01:21 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-4236c9f1-60bc-446f-85a5-0f74244d2b3d tempest-ServerRescueNegativeTestJSON-509507797 tempest-ServerRescueNegativeTestJSON-509507797-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 04:01:21 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-4236c9f1-60bc-446f-85a5-0f74244d2b3d tempest-ServerRescueNegativeTestJSON-509507797 tempest-ServerRescueNegativeTestJSON-509507797-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 04:01:21 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-4236c9f1-60bc-446f-85a5-0f74244d2b3d tempest-ServerRescueNegativeTestJSON-509507797 tempest-ServerRescueNegativeTestJSON-509507797-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 04:01:21 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-4236c9f1-60bc-446f-85a5-0f74244d2b3d tempest-ServerRescueNegativeTestJSON-509507797 tempest-ServerRescueNegativeTestJSON-509507797-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 04:01:21 user devstack@n-api.service[61307]: DEBUG nova.policy [None req-4236c9f1-60bc-446f-85a5-0f74244d2b3d tempest-ServerRescueNegativeTestJSON-509507797 tempest-ServerRescueNegativeTestJSON-509507797-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b2f522c7164c5c934b8bbf113b542a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db4b7bdc478946e2ad0a2060b433b42c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61307) authorize /opt/stack/nova/nova/policy.py:203}} Apr 23 04:01:21 user devstack@n-api.service[61307]: INFO nova.api.openstack.requestlog [None req-4236c9f1-60bc-446f-85a5-0f74244d2b3d tempest-ServerRescueNegativeTestJSON-509507797 tempest-ServerRescueNegativeTestJSON-509507797-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7d5ef4db-70d7-4545-9ddb-92ecdf4ebb23" status: 200 len: 1490 microversion: 2.1 time: 0.222151 Apr 23 04:01:21 user devstack@n-api.service[61307]: [pid: 61307|app: 0|req: 129/387] 10.0.0.210 () {62 vars in 1313 bytes} [Sun Apr 23 04:01:21 2023] GET /compute/v2.1/servers/7d5ef4db-70d7-4545-9ddb-92ecdf4ebb23 => generated 1490 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 23 04:01:54 user devstack@n-api.service[61306]: DEBUG dbcounter [-] [61306] Writing DB stats nova_api:SELECT=2 {{(pid=61306) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 04:01:54 user devstack@n-api.service[61306]: DEBUG dbcounter [-] [61306] Writing DB stats nova_cell1:SELECT=2 {{(pid=61306) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 04:01:54 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi [None req-da33f62d-5727-4695-a804-9681ae2824a7 tempest-ServersNegativeTestJSON-1115615559 tempest-ServersNegativeTestJSON-1115615559-project-member] Calling method '>' {{(pid=61306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 04:01:54 user devstack@n-api.service[61306]: DEBUG nova.compute.api [None req-da33f62d-5727-4695-a804-9681ae2824a7 tempest-ServersNegativeTestJSON-1115615559 tempest-ServersNegativeTestJSON-1115615559-project-member] [instance: ee89a9d5-0507-475c-bea2-e02e34d15710] Fetching instance by UUID {{(pid=61306) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 23 04:01:54 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-da33f62d-5727-4695-a804-9681ae2824a7 tempest-ServersNegativeTestJSON-1115615559 tempest-ServersNegativeTestJSON-1115615559-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 04:01:54 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-da33f62d-5727-4695-a804-9681ae2824a7 tempest-ServersNegativeTestJSON-1115615559 tempest-ServersNegativeTestJSON-1115615559-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 04:01:54 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-da33f62d-5727-4695-a804-9681ae2824a7 tempest-ServersNegativeTestJSON-1115615559 tempest-ServersNegativeTestJSON-1115615559-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 04:01:54 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-da33f62d-5727-4695-a804-9681ae2824a7 tempest-ServersNegativeTestJSON-1115615559 tempest-ServersNegativeTestJSON-1115615559-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 04:01:54 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-da33f62d-5727-4695-a804-9681ae2824a7 tempest-ServersNegativeTestJSON-1115615559 tempest-ServersNegativeTestJSON-1115615559-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 04:01:54 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-da33f62d-5727-4695-a804-9681ae2824a7 tempest-ServersNegativeTestJSON-1115615559 tempest-ServersNegativeTestJSON-1115615559-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 04:01:55 user devstack@n-api.service[61306]: DEBUG nova.policy [None req-da33f62d-5727-4695-a804-9681ae2824a7 tempest-ServersNegativeTestJSON-1115615559 tempest-ServersNegativeTestJSON-1115615559-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d9ae4a3b00492fa2fc16a22a34df09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39d6cb4cfcb2413f8039ee9febf1c046', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61306) authorize /opt/stack/nova/nova/policy.py:203}} Apr 23 04:01:55 user devstack@n-api.service[61306]: INFO nova.api.openstack.requestlog [None req-da33f62d-5727-4695-a804-9681ae2824a7 tempest-ServersNegativeTestJSON-1115615559 tempest-ServersNegativeTestJSON-1115615559-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ee89a9d5-0507-475c-bea2-e02e34d15710" status: 200 len: 1495 microversion: 2.1 time: 0.300156 Apr 23 04:01:55 user devstack@n-api.service[61306]: [pid: 61306|app: 0|req: 128/388] 10.0.0.210 () {62 vars in 1313 bytes} [Sun Apr 23 04:01:54 2023] GET /compute/v2.1/servers/ee89a9d5-0507-475c-bea2-e02e34d15710 => generated 1495 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 23 04:02:21 user devstack@n-api.service[61308]: DEBUG dbcounter [-] [61308] Writing DB stats nova_api:SELECT=2 {{(pid=61308) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 04:02:21 user devstack@n-api.service[61308]: DEBUG dbcounter [-] [61308] Writing DB stats nova_cell1:SELECT=6 {{(pid=61308) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 04:02:21 user devstack@n-api.service[61308]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 23 04:02:21 user devstack@n-api.service[61308]: Sun Apr 23 04:02:21 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/27abe5af-8845-40e6-a9c3-12399369b117 (ip 10.0.0.210) !!! Apr 23 04:02:21 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi [None req-6ec8bad6-f0db-4c56-8ef9-934753428c82 tempest-ServerRescueNegativeTestJSON-509507797 tempest-ServerRescueNegativeTestJSON-509507797-project-member] Calling method '>' {{(pid=61308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 04:02:21 user devstack@n-api.service[61308]: DEBUG nova.compute.api [None req-6ec8bad6-f0db-4c56-8ef9-934753428c82 tempest-ServerRescueNegativeTestJSON-509507797 tempest-ServerRescueNegativeTestJSON-509507797-project-member] [instance: 27abe5af-8845-40e6-a9c3-12399369b117] Fetching instance by UUID {{(pid=61308) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 23 04:02:21 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-6ec8bad6-f0db-4c56-8ef9-934753428c82 tempest-ServerRescueNegativeTestJSON-509507797 tempest-ServerRescueNegativeTestJSON-509507797-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 04:02:21 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-6ec8bad6-f0db-4c56-8ef9-934753428c82 tempest-ServerRescueNegativeTestJSON-509507797 tempest-ServerRescueNegativeTestJSON-509507797-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 04:02:21 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-6ec8bad6-f0db-4c56-8ef9-934753428c82 tempest-ServerRescueNegativeTestJSON-509507797 tempest-ServerRescueNegativeTestJSON-509507797-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 04:02:21 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-6ec8bad6-f0db-4c56-8ef9-934753428c82 tempest-ServerRescueNegativeTestJSON-509507797 tempest-ServerRescueNegativeTestJSON-509507797-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 04:02:21 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-6ec8bad6-f0db-4c56-8ef9-934753428c82 tempest-ServerRescueNegativeTestJSON-509507797 tempest-ServerRescueNegativeTestJSON-509507797-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 04:02:21 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-6ec8bad6-f0db-4c56-8ef9-934753428c82 tempest-ServerRescueNegativeTestJSON-509507797 tempest-ServerRescueNegativeTestJSON-509507797-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 04:02:21 user devstack@n-api.service[61308]: DEBUG nova.policy [None req-6ec8bad6-f0db-4c56-8ef9-934753428c82 tempest-ServerRescueNegativeTestJSON-509507797 tempest-ServerRescueNegativeTestJSON-509507797-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b2f522c7164c5c934b8bbf113b542a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db4b7bdc478946e2ad0a2060b433b42c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61308) authorize /opt/stack/nova/nova/policy.py:203}} Apr 23 04:02:21 user devstack@n-api.service[61308]: INFO nova.api.openstack.requestlog [None req-6ec8bad6-f0db-4c56-8ef9-934753428c82 tempest-ServerRescueNegativeTestJSON-509507797 tempest-ServerRescueNegativeTestJSON-509507797-project-member] 10.0.0.210 "GET /compute/v2.1/servers/27abe5af-8845-40e6-a9c3-12399369b117" status: 200 len: 1504 microversion: 2.1 time: 0.220848 Apr 23 04:02:21 user devstack@n-api.service[61308]: [pid: 61308|app: 0|req: 132/389] 10.0.0.210 () {62 vars in 1313 bytes} [Sun Apr 23 04:02:21 2023] GET /compute/v2.1/servers/27abe5af-8845-40e6-a9c3-12399369b117 => generated 1504 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 23 04:02:55 user devstack@n-api.service[61307]: DEBUG dbcounter [-] [61307] Writing DB stats nova_api:SELECT=2 {{(pid=61307) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 04:02:55 user devstack@n-api.service[61307]: DEBUG dbcounter [-] [61307] Writing DB stats nova_cell1:SELECT=6 {{(pid=61307) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 04:02:55 user devstack@n-api.service[61307]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 23 04:02:55 user devstack@n-api.service[61307]: Sun Apr 23 04:02:55 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ee89a9d5-0507-475c-bea2-e02e34d15710 (ip 10.0.0.210) !!! Apr 23 04:02:55 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi [None req-083faa43-1eef-424a-87a8-5ba05338f27a tempest-ServersNegativeTestJSON-1115615559 tempest-ServersNegativeTestJSON-1115615559-project-member] Calling method '>' {{(pid=61307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 04:02:55 user devstack@n-api.service[61307]: DEBUG nova.compute.api [None req-083faa43-1eef-424a-87a8-5ba05338f27a tempest-ServersNegativeTestJSON-1115615559 tempest-ServersNegativeTestJSON-1115615559-project-member] [instance: ee89a9d5-0507-475c-bea2-e02e34d15710] Fetching instance by UUID {{(pid=61307) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 23 04:02:55 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-083faa43-1eef-424a-87a8-5ba05338f27a tempest-ServersNegativeTestJSON-1115615559 tempest-ServersNegativeTestJSON-1115615559-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 04:02:55 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-083faa43-1eef-424a-87a8-5ba05338f27a tempest-ServersNegativeTestJSON-1115615559 tempest-ServersNegativeTestJSON-1115615559-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 04:02:55 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-083faa43-1eef-424a-87a8-5ba05338f27a tempest-ServersNegativeTestJSON-1115615559 tempest-ServersNegativeTestJSON-1115615559-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 04:02:55 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-083faa43-1eef-424a-87a8-5ba05338f27a tempest-ServersNegativeTestJSON-1115615559 tempest-ServersNegativeTestJSON-1115615559-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 04:02:55 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-083faa43-1eef-424a-87a8-5ba05338f27a tempest-ServersNegativeTestJSON-1115615559 tempest-ServersNegativeTestJSON-1115615559-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 04:02:55 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-083faa43-1eef-424a-87a8-5ba05338f27a tempest-ServersNegativeTestJSON-1115615559 tempest-ServersNegativeTestJSON-1115615559-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 04:02:55 user devstack@n-api.service[61307]: DEBUG nova.policy [None req-083faa43-1eef-424a-87a8-5ba05338f27a tempest-ServersNegativeTestJSON-1115615559 tempest-ServersNegativeTestJSON-1115615559-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d9ae4a3b00492fa2fc16a22a34df09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39d6cb4cfcb2413f8039ee9febf1c046', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61307) authorize /opt/stack/nova/nova/policy.py:203}} Apr 23 04:02:55 user devstack@n-api.service[61307]: INFO nova.api.openstack.requestlog [None req-083faa43-1eef-424a-87a8-5ba05338f27a tempest-ServersNegativeTestJSON-1115615559 tempest-ServersNegativeTestJSON-1115615559-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ee89a9d5-0507-475c-bea2-e02e34d15710" status: 200 len: 1495 microversion: 2.1 time: 0.548784 Apr 23 04:02:55 user devstack@n-api.service[61307]: [pid: 61307|app: 0|req: 130/390] 10.0.0.210 () {62 vars in 1313 bytes} [Sun Apr 23 04:02:55 2023] GET /compute/v2.1/servers/ee89a9d5-0507-475c-bea2-e02e34d15710 => generated 1495 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 23 04:03:25 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi [None req-15edb0a1-b10a-403d-9178-a79b05664efe tempest-ServerRescueNegativeTestJSON-509507797 tempest-ServerRescueNegativeTestJSON-509507797-project-member] Calling method '>' {{(pid=61306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 04:03:25 user devstack@n-api.service[61306]: DEBUG nova.compute.api [None req-15edb0a1-b10a-403d-9178-a79b05664efe tempest-ServerRescueNegativeTestJSON-509507797 tempest-ServerRescueNegativeTestJSON-509507797-project-member] [instance: 7d5ef4db-70d7-4545-9ddb-92ecdf4ebb23] Fetching instance by UUID {{(pid=61306) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 23 04:03:25 user devstack@n-api.service[61306]: DEBUG dbcounter [-] [61306] Writing DB stats nova_api:SELECT=2 {{(pid=61306) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 04:03:25 user devstack@n-api.service[61306]: DEBUG dbcounter [-] [61306] Writing DB stats nova_cell1:SELECT=6 {{(pid=61306) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 04:03:25 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-15edb0a1-b10a-403d-9178-a79b05664efe tempest-ServerRescueNegativeTestJSON-509507797 tempest-ServerRescueNegativeTestJSON-509507797-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 04:03:25 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-15edb0a1-b10a-403d-9178-a79b05664efe tempest-ServerRescueNegativeTestJSON-509507797 tempest-ServerRescueNegativeTestJSON-509507797-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 04:03:25 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-15edb0a1-b10a-403d-9178-a79b05664efe tempest-ServerRescueNegativeTestJSON-509507797 tempest-ServerRescueNegativeTestJSON-509507797-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 04:03:25 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-15edb0a1-b10a-403d-9178-a79b05664efe tempest-ServerRescueNegativeTestJSON-509507797 tempest-ServerRescueNegativeTestJSON-509507797-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 04:03:25 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-15edb0a1-b10a-403d-9178-a79b05664efe tempest-ServerRescueNegativeTestJSON-509507797 tempest-ServerRescueNegativeTestJSON-509507797-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 04:03:25 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-15edb0a1-b10a-403d-9178-a79b05664efe tempest-ServerRescueNegativeTestJSON-509507797 tempest-ServerRescueNegativeTestJSON-509507797-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 04:03:25 user devstack@n-api.service[61306]: DEBUG nova.compute.api [None req-15edb0a1-b10a-403d-9178-a79b05664efe tempest-ServerRescueNegativeTestJSON-509507797 tempest-ServerRescueNegativeTestJSON-509507797-project-member] [instance: 7d5ef4db-70d7-4545-9ddb-92ecdf4ebb23] Going to try to terminate instance {{(pid=61306) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 23 04:03:25 user devstack@n-api.service[61306]: INFO nova.api.openstack.requestlog [None req-15edb0a1-b10a-403d-9178-a79b05664efe tempest-ServerRescueNegativeTestJSON-509507797 tempest-ServerRescueNegativeTestJSON-509507797-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/7d5ef4db-70d7-4545-9ddb-92ecdf4ebb23" status: 204 len: 0 microversion: 2.1 time: 0.137515 Apr 23 04:03:25 user devstack@n-api.service[61306]: [pid: 61306|app: 0|req: 129/391] 10.0.0.210 () {62 vars in 1316 bytes} [Sun Apr 23 04:03:25 2023] DELETE /compute/v2.1/servers/7d5ef4db-70d7-4545-9ddb-92ecdf4ebb23 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 23 04:03:25 user devstack@n-api.service[61308]: DEBUG dbcounter [-] [61308] Writing DB stats nova_api:SELECT=2 {{(pid=61308) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 04:03:25 user devstack@n-api.service[61308]: DEBUG dbcounter [-] [61308] Writing DB stats nova_cell1:SELECT=6 {{(pid=61308) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 04:03:25 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi [None req-8e898044-469f-443d-a968-0692dc218344 tempest-ServerRescueNegativeTestJSON-509507797 tempest-ServerRescueNegativeTestJSON-509507797-project-member] Calling method '>' {{(pid=61308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 04:03:25 user devstack@n-api.service[61308]: DEBUG nova.compute.api [None req-8e898044-469f-443d-a968-0692dc218344 tempest-ServerRescueNegativeTestJSON-509507797 tempest-ServerRescueNegativeTestJSON-509507797-project-member] [instance: 7d5ef4db-70d7-4545-9ddb-92ecdf4ebb23] Fetching instance by UUID {{(pid=61308) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 23 04:03:25 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-8e898044-469f-443d-a968-0692dc218344 tempest-ServerRescueNegativeTestJSON-509507797 tempest-ServerRescueNegativeTestJSON-509507797-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 04:03:25 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-8e898044-469f-443d-a968-0692dc218344 tempest-ServerRescueNegativeTestJSON-509507797 tempest-ServerRescueNegativeTestJSON-509507797-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 04:03:25 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-8e898044-469f-443d-a968-0692dc218344 tempest-ServerRescueNegativeTestJSON-509507797 tempest-ServerRescueNegativeTestJSON-509507797-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 04:03:25 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-8e898044-469f-443d-a968-0692dc218344 tempest-ServerRescueNegativeTestJSON-509507797 tempest-ServerRescueNegativeTestJSON-509507797-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 04:03:25 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-8e898044-469f-443d-a968-0692dc218344 tempest-ServerRescueNegativeTestJSON-509507797 tempest-ServerRescueNegativeTestJSON-509507797-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 04:03:25 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-8e898044-469f-443d-a968-0692dc218344 tempest-ServerRescueNegativeTestJSON-509507797 tempest-ServerRescueNegativeTestJSON-509507797-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 04:03:25 user devstack@n-api.service[61308]: DEBUG nova.policy [None req-8e898044-469f-443d-a968-0692dc218344 tempest-ServerRescueNegativeTestJSON-509507797 tempest-ServerRescueNegativeTestJSON-509507797-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b2f522c7164c5c934b8bbf113b542a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db4b7bdc478946e2ad0a2060b433b42c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61308) authorize /opt/stack/nova/nova/policy.py:203}} Apr 23 04:03:25 user devstack@n-api.service[61308]: INFO nova.api.openstack.requestlog [None req-8e898044-469f-443d-a968-0692dc218344 tempest-ServerRescueNegativeTestJSON-509507797 tempest-ServerRescueNegativeTestJSON-509507797-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7d5ef4db-70d7-4545-9ddb-92ecdf4ebb23" status: 200 len: 1496 microversion: 2.1 time: 0.306030 Apr 23 04:03:25 user devstack@n-api.service[61308]: [pid: 61308|app: 0|req: 133/392] 10.0.0.210 () {62 vars in 1313 bytes} [Sun Apr 23 04:03:25 2023] GET /compute/v2.1/servers/7d5ef4db-70d7-4545-9ddb-92ecdf4ebb23 => generated 1496 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 23 04:03:25 user devstack@n-api.service[61307]: DEBUG dbcounter [-] [61307] Writing DB stats nova_api:SELECT=2 {{(pid=61307) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 04:03:25 user devstack@n-api.service[61307]: DEBUG dbcounter [-] [61307] Writing DB stats nova_cell1:SELECT=6 {{(pid=61307) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 04:03:25 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi [req-1040585d-4bd7-4baf-98d5-b3f9aa0a7f0b req-0bf3000e-23f8-4d4e-bc08-2baa2764f25b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d5ef4db-70d7-4545-9ddb-92ecdf4ebb23", "name": "network-vif-unplugged", "status": "completed", "tag": "c79b33fd-e966-4247-a5e7-3b6ee20d635c"}]} {{(pid=61307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 04:03:25 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [req-1040585d-4bd7-4baf-98d5-b3f9aa0a7f0b req-0bf3000e-23f8-4d4e-bc08-2baa2764f25b service nova] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 04:03:25 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [req-1040585d-4bd7-4baf-98d5-b3f9aa0a7f0b req-0bf3000e-23f8-4d4e-bc08-2baa2764f25b service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 04:03:25 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [req-1040585d-4bd7-4baf-98d5-b3f9aa0a7f0b req-0bf3000e-23f8-4d4e-bc08-2baa2764f25b service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 04:03:25 user devstack@n-api.service[61307]: INFO nova.api.openstack.compute.server_external_events [req-1040585d-4bd7-4baf-98d5-b3f9aa0a7f0b req-0bf3000e-23f8-4d4e-bc08-2baa2764f25b service nova] Creating event network-vif-unplugged:c79b33fd-e966-4247-a5e7-3b6ee20d635c for instance 7d5ef4db-70d7-4545-9ddb-92ecdf4ebb23 on user Apr 23 04:03:25 user devstack@n-api.service[61307]: INFO nova.api.openstack.requestlog [req-1040585d-4bd7-4baf-98d5-b3f9aa0a7f0b req-0bf3000e-23f8-4d4e-bc08-2baa2764f25b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.110572 Apr 23 04:03:25 user devstack@n-api.service[61307]: [pid: 61307|app: 0|req: 131/393] 10.0.0.210 () {68 vars in 1394 bytes} [Sun Apr 23 04:03:25 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 23 04:03:27 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi [req-0f29b9b8-dd98-4c6a-a303-a9de2bf821d2 req-473b7f03-f489-497b-ba9a-e8e44235a4c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d5ef4db-70d7-4545-9ddb-92ecdf4ebb23", "name": "network-vif-plugged", "status": "completed", "tag": "c79b33fd-e966-4247-a5e7-3b6ee20d635c"}, {"server_uuid": "7d5ef4db-70d7-4545-9ddb-92ecdf4ebb23", "name": "network-vif-deleted", "tag": "c79b33fd-e966-4247-a5e7-3b6ee20d635c"}]} {{(pid=61306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 04:03:27 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [req-0f29b9b8-dd98-4c6a-a303-a9de2bf821d2 req-473b7f03-f489-497b-ba9a-e8e44235a4c5 service nova] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 04:03:27 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [req-0f29b9b8-dd98-4c6a-a303-a9de2bf821d2 req-473b7f03-f489-497b-ba9a-e8e44235a4c5 service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 04:03:27 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [req-0f29b9b8-dd98-4c6a-a303-a9de2bf821d2 req-473b7f03-f489-497b-ba9a-e8e44235a4c5 service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 04:03:27 user devstack@n-api.service[61306]: INFO nova.api.openstack.compute.server_external_events [req-0f29b9b8-dd98-4c6a-a303-a9de2bf821d2 req-473b7f03-f489-497b-ba9a-e8e44235a4c5 service nova] Creating event network-vif-plugged:c79b33fd-e966-4247-a5e7-3b6ee20d635c for instance 7d5ef4db-70d7-4545-9ddb-92ecdf4ebb23 on user Apr 23 04:03:27 user devstack@n-api.service[61306]: INFO nova.api.openstack.compute.server_external_events [req-0f29b9b8-dd98-4c6a-a303-a9de2bf821d2 req-473b7f03-f489-497b-ba9a-e8e44235a4c5 service nova] Creating event network-vif-deleted:c79b33fd-e966-4247-a5e7-3b6ee20d635c for instance 7d5ef4db-70d7-4545-9ddb-92ecdf4ebb23 on user Apr 23 04:03:27 user devstack@n-api.service[61306]: INFO nova.api.openstack.requestlog [req-0f29b9b8-dd98-4c6a-a303-a9de2bf821d2 req-473b7f03-f489-497b-ba9a-e8e44235a4c5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.030517 Apr 23 04:03:27 user devstack@n-api.service[61306]: [pid: 61306|app: 0|req: 130/394] 10.0.0.210 () {68 vars in 1394 bytes} [Sun Apr 23 04:03:27 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 23 04:03:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi [None req-8334a352-34be-445a-8cbf-ac70f30bcc09 tempest-ServersNegativeTestJSON-1115615559 tempest-ServersNegativeTestJSON-1115615559-project-member] Calling method '>' {{(pid=61308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 04:03:57 user devstack@n-api.service[61308]: DEBUG nova.compute.api [None req-8334a352-34be-445a-8cbf-ac70f30bcc09 tempest-ServersNegativeTestJSON-1115615559 tempest-ServersNegativeTestJSON-1115615559-project-member] [instance: ee89a9d5-0507-475c-bea2-e02e34d15710] Fetching instance by UUID {{(pid=61308) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 23 04:03:57 user devstack@n-api.service[61308]: DEBUG dbcounter [-] [61308] Writing DB stats nova_api:SELECT=2 {{(pid=61308) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 04:03:57 user devstack@n-api.service[61308]: DEBUG dbcounter [-] [61308] Writing DB stats nova_cell1:SELECT=6 {{(pid=61308) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 04:03:57 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-8334a352-34be-445a-8cbf-ac70f30bcc09 tempest-ServersNegativeTestJSON-1115615559 tempest-ServersNegativeTestJSON-1115615559-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 04:03:57 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-8334a352-34be-445a-8cbf-ac70f30bcc09 tempest-ServersNegativeTestJSON-1115615559 tempest-ServersNegativeTestJSON-1115615559-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 04:03:57 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-8334a352-34be-445a-8cbf-ac70f30bcc09 tempest-ServersNegativeTestJSON-1115615559 tempest-ServersNegativeTestJSON-1115615559-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 04:03:57 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-8334a352-34be-445a-8cbf-ac70f30bcc09 tempest-ServersNegativeTestJSON-1115615559 tempest-ServersNegativeTestJSON-1115615559-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 04:03:57 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-8334a352-34be-445a-8cbf-ac70f30bcc09 tempest-ServersNegativeTestJSON-1115615559 tempest-ServersNegativeTestJSON-1115615559-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 04:03:57 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-8334a352-34be-445a-8cbf-ac70f30bcc09 tempest-ServersNegativeTestJSON-1115615559 tempest-ServersNegativeTestJSON-1115615559-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 04:03:57 user devstack@n-api.service[61308]: DEBUG nova.policy [None req-8334a352-34be-445a-8cbf-ac70f30bcc09 tempest-ServersNegativeTestJSON-1115615559 tempest-ServersNegativeTestJSON-1115615559-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d9ae4a3b00492fa2fc16a22a34df09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39d6cb4cfcb2413f8039ee9febf1c046', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61308) authorize /opt/stack/nova/nova/policy.py:203}} Apr 23 04:03:57 user devstack@n-api.service[61308]: INFO nova.api.openstack.requestlog [None req-8334a352-34be-445a-8cbf-ac70f30bcc09 tempest-ServersNegativeTestJSON-1115615559 tempest-ServersNegativeTestJSON-1115615559-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ee89a9d5-0507-475c-bea2-e02e34d15710" status: 200 len: 1495 microversion: 2.1 time: 0.229012 Apr 23 04:03:57 user devstack@n-api.service[61308]: [pid: 61308|app: 0|req: 134/395] 10.0.0.210 () {62 vars in 1313 bytes} [Sun Apr 23 04:03:57 2023] GET /compute/v2.1/servers/ee89a9d5-0507-475c-bea2-e02e34d15710 => generated 1495 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 23 04:04:15 user devstack@n-api.service[61307]: DEBUG dbcounter [-] [61307] Writing DB stats nova_api:SELECT=2 {{(pid=61307) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 04:04:15 user devstack@n-api.service[61307]: DEBUG dbcounter [-] [61307] Writing DB stats nova_cell1:SELECT=2 {{(pid=61307) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 04:04:15 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi [None req-a9c60aa1-a7f8-430f-a65f-97e429d44691 tempest-ServerRescueNegativeTestJSON-509507797 tempest-ServerRescueNegativeTestJSON-509507797-project-member] Calling method '>' {{(pid=61307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 04:04:15 user devstack@n-api.service[61307]: DEBUG nova.compute.api [None req-a9c60aa1-a7f8-430f-a65f-97e429d44691 tempest-ServerRescueNegativeTestJSON-509507797 tempest-ServerRescueNegativeTestJSON-509507797-project-member] [instance: 7d5ef4db-70d7-4545-9ddb-92ecdf4ebb23] Fetching instance by UUID {{(pid=61307) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 23 04:04:15 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-a9c60aa1-a7f8-430f-a65f-97e429d44691 tempest-ServerRescueNegativeTestJSON-509507797 tempest-ServerRescueNegativeTestJSON-509507797-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 04:04:15 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-a9c60aa1-a7f8-430f-a65f-97e429d44691 tempest-ServerRescueNegativeTestJSON-509507797 tempest-ServerRescueNegativeTestJSON-509507797-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 04:04:15 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-a9c60aa1-a7f8-430f-a65f-97e429d44691 tempest-ServerRescueNegativeTestJSON-509507797 tempest-ServerRescueNegativeTestJSON-509507797-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 04:04:15 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-a9c60aa1-a7f8-430f-a65f-97e429d44691 tempest-ServerRescueNegativeTestJSON-509507797 tempest-ServerRescueNegativeTestJSON-509507797-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 04:04:15 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-a9c60aa1-a7f8-430f-a65f-97e429d44691 tempest-ServerRescueNegativeTestJSON-509507797 tempest-ServerRescueNegativeTestJSON-509507797-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 04:04:15 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-a9c60aa1-a7f8-430f-a65f-97e429d44691 tempest-ServerRescueNegativeTestJSON-509507797 tempest-ServerRescueNegativeTestJSON-509507797-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 04:04:15 user devstack@n-api.service[61307]: INFO nova.api.openstack.wsgi [None req-a9c60aa1-a7f8-430f-a65f-97e429d44691 tempest-ServerRescueNegativeTestJSON-509507797 tempest-ServerRescueNegativeTestJSON-509507797-project-member] HTTP exception thrown: Instance 7d5ef4db-70d7-4545-9ddb-92ecdf4ebb23 could not be found. Apr 23 04:04:15 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi [None req-a9c60aa1-a7f8-430f-a65f-97e429d44691 tempest-ServerRescueNegativeTestJSON-509507797 tempest-ServerRescueNegativeTestJSON-509507797-project-member] Request method failure captured: Apr 23 04:04:15 user devstack@n-api.service[61307]: request: GET /compute/v2.1/servers/7d5ef4db-70d7-4545-9ddb-92ecdf4ebb23 HTTP/1.1 Apr 23 04:04:15 user devstack@n-api.service[61307]: Accept: application/json Apr 23 04:04:15 user devstack@n-api.service[61307]: Accept-Encoding: identity Apr 23 04:04:15 user devstack@n-api.service[61307]: Connection: close Apr 23 04:04:15 user devstack@n-api.service[61307]: Content-Length: 0 Apr 23 04:04:15 user devstack@n-api.service[61307]: Content-Type: application/json Apr 23 04:04:15 user devstack@n-api.service[61307]: Host: 10.0.0.210 Apr 23 04:04:15 user devstack@n-api.service[61307]: Openstack-System-Scope: None Apr 23 04:04:15 user devstack@n-api.service[61307]: User-Agent: python-urllib3/1.26.15 Apr 23 04:04:15 user devstack@n-api.service[61307]: X-Auth-Token: gAAAAABkRKzufIl90mvkTctwBYIOp6FDUjerVEPjISvtBVYkfxaQKagt3sixvQ2X9nugU2JfiELh_bn6alNo2PD3zQ0SmgpseWTrvEBta1ov6u7fHq7rVsbYzjHvO5N-_9jhESBttWSnjWvgQHfxf1X2jM11jS5lfPyXtTILzIL478uVWCL4pEs Apr 23 04:04:15 user devstack@n-api.service[61307]: X-Domain-Id: None Apr 23 04:04:15 user devstack@n-api.service[61307]: X-Domain-Name: None Apr 23 04:04:15 user devstack@n-api.service[61307]: X-Identity-Status: Confirmed Apr 23 04:04:15 user devstack@n-api.service[61307]: X-Is-Admin-Project: True Apr 23 04:04:15 user devstack@n-api.service[61307]: X-Project-Domain-Id: default Apr 23 04:04:15 user devstack@n-api.service[61307]: X-Project-Domain-Name: Default Apr 23 04:04:15 user devstack@n-api.service[61307]: X-Project-Id: db4b7bdc478946e2ad0a2060b433b42c Apr 23 04:04:15 user devstack@n-api.service[61307]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-509507797 Apr 23 04:04:15 user devstack@n-api.service[61307]: X-Role: reader,member Apr 23 04:04:15 user devstack@n-api.service[61307]: X-Roles: reader,member Apr 23 04:04:15 user devstack@n-api.service[61307]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/db4b7bdc478946e2ad0a2060b433b42c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/db4b7bdc478946e2ad0a2060b433b42c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/db4b7bdc478946e2ad0a2060b433b42c"}]}] Apr 23 04:04:15 user devstack@n-api.service[61307]: X-Tenant: tempest-ServerRescueNegativeTestJSON-509507797 Apr 23 04:04:15 user devstack@n-api.service[61307]: X-Tenant-Id: db4b7bdc478946e2ad0a2060b433b42c Apr 23 04:04:15 user devstack@n-api.service[61307]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-509507797 Apr 23 04:04:15 user devstack@n-api.service[61307]: X-User: tempest-ServerRescueNegativeTestJSON-509507797-project-member Apr 23 04:04:15 user devstack@n-api.service[61307]: X-User-Domain-Id: default Apr 23 04:04:15 user devstack@n-api.service[61307]: X-User-Domain-Name: Default Apr 23 04:04:15 user devstack@n-api.service[61307]: X-User-Id: 84b2f522c7164c5c934b8bbf113b542a Apr 23 04:04:15 user devstack@n-api.service[61307]: X-User-Name: tempest-ServerRescueNegativeTestJSON-509507797-project-member Apr 23 04:04:15 user devstack@n-api.service[61307]: method: > Apr 23 04:04:15 user devstack@n-api.service[61307]: exception: Instance 7d5ef4db-70d7-4545-9ddb-92ecdf4ebb23 could not be found. Apr 23 04:04:15 user devstack@n-api.service[61307]: action_args: {'id': '7d5ef4db-70d7-4545-9ddb-92ecdf4ebb23'} Apr 23 04:04:15 user devstack@n-api.service[61307]: {{(pid=61307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 23 04:04:15 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 23 04:04:15 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 23 04:04:15 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 23 04:04:15 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 23 04:04:15 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 23 04:04:15 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 23 04:04:15 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 23 04:04:15 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 23 04:04:15 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 23 04:04:15 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d5ef4db-70d7-4545-9ddb-92ecdf4ebb23 could not be found. Apr 23 04:04:15 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi Apr 23 04:04:15 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 23 04:04:15 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi Apr 23 04:04:15 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 23 04:04:15 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 23 04:04:15 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 23 04:04:15 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 23 04:04:15 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 23 04:04:15 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 23 04:04:15 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 23 04:04:15 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 23 04:04:15 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 23 04:04:15 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 23 04:04:15 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 23 04:04:15 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 23 04:04:15 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 23 04:04:15 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d5ef4db-70d7-4545-9ddb-92ecdf4ebb23 could not be found. Apr 23 04:04:15 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi Apr 23 04:04:15 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 23 04:04:15 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi Apr 23 04:04:15 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 23 04:04:15 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 23 04:04:15 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 23 04:04:15 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 23 04:04:15 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 23 04:04:15 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d5ef4db-70d7-4545-9ddb-92ecdf4ebb23 could not be found. Apr 23 04:04:15 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi Apr 23 04:04:15 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi [None req-a9c60aa1-a7f8-430f-a65f-97e429d44691 tempest-ServerRescueNegativeTestJSON-509507797 tempest-ServerRescueNegativeTestJSON-509507797-project-member] Returning 404 to user: Instance 7d5ef4db-70d7-4545-9ddb-92ecdf4ebb23 could not be found. {{(pid=61307) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 23 04:04:15 user devstack@n-api.service[61307]: INFO nova.api.openstack.requestlog [None req-a9c60aa1-a7f8-430f-a65f-97e429d44691 tempest-ServerRescueNegativeTestJSON-509507797 tempest-ServerRescueNegativeTestJSON-509507797-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7d5ef4db-70d7-4545-9ddb-92ecdf4ebb23" status: 404 len: 111 microversion: 2.1 time: 0.081879 Apr 23 04:04:15 user devstack@n-api.service[61307]: [pid: 61307|app: 0|req: 132/396] 10.0.0.210 () {62 vars in 1313 bytes} [Sun Apr 23 04:04:15 2023] GET /compute/v2.1/servers/7d5ef4db-70d7-4545-9ddb-92ecdf4ebb23 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 23 04:04:15 user devstack@n-api.service[61306]: DEBUG dbcounter [-] [61306] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61306) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 04:04:15 user devstack@n-api.service[61306]: DEBUG dbcounter [-] [61306] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61306) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 04:04:15 user devstack@n-api.service[61306]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Apr 23 04:04:15 user devstack@n-api.service[61306]: Sun Apr 23 04:04:15 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/27abe5af-8845-40e6-a9c3-12399369b117 (ip 10.0.0.210) !!! Apr 23 04:04:15 user devstack@n-api.service[61306]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Apr 23 04:04:15 user devstack@n-api.service[61306]: Sun Apr 23 04:04:15 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/27abe5af-8845-40e6-a9c3-12399369b117 (ip 10.0.0.210) !!! Apr 23 04:04:15 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi [None req-0338fc77-aede-436c-9a0d-2f02fc1bffbc tempest-ServerRescueNegativeTestJSON-509507797 tempest-ServerRescueNegativeTestJSON-509507797-project-member] Calling method '>' {{(pid=61306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 04:04:15 user devstack@n-api.service[61306]: DEBUG nova.compute.api [None req-0338fc77-aede-436c-9a0d-2f02fc1bffbc tempest-ServerRescueNegativeTestJSON-509507797 tempest-ServerRescueNegativeTestJSON-509507797-project-member] [instance: 27abe5af-8845-40e6-a9c3-12399369b117] Fetching instance by UUID {{(pid=61306) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 23 04:04:15 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-0338fc77-aede-436c-9a0d-2f02fc1bffbc tempest-ServerRescueNegativeTestJSON-509507797 tempest-ServerRescueNegativeTestJSON-509507797-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 04:04:15 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-0338fc77-aede-436c-9a0d-2f02fc1bffbc tempest-ServerRescueNegativeTestJSON-509507797 tempest-ServerRescueNegativeTestJSON-509507797-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 04:04:15 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-0338fc77-aede-436c-9a0d-2f02fc1bffbc tempest-ServerRescueNegativeTestJSON-509507797 tempest-ServerRescueNegativeTestJSON-509507797-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 04:04:15 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-0338fc77-aede-436c-9a0d-2f02fc1bffbc tempest-ServerRescueNegativeTestJSON-509507797 tempest-ServerRescueNegativeTestJSON-509507797-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 04:04:15 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-0338fc77-aede-436c-9a0d-2f02fc1bffbc tempest-ServerRescueNegativeTestJSON-509507797 tempest-ServerRescueNegativeTestJSON-509507797-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 04:04:15 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-0338fc77-aede-436c-9a0d-2f02fc1bffbc tempest-ServerRescueNegativeTestJSON-509507797 tempest-ServerRescueNegativeTestJSON-509507797-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 04:04:15 user devstack@n-api.service[61306]: DEBUG nova.compute.api [None req-0338fc77-aede-436c-9a0d-2f02fc1bffbc tempest-ServerRescueNegativeTestJSON-509507797 tempest-ServerRescueNegativeTestJSON-509507797-project-member] [instance: 27abe5af-8845-40e6-a9c3-12399369b117] Going to try to terminate instance {{(pid=61306) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 23 04:04:15 user devstack@n-api.service[61306]: INFO nova.api.openstack.requestlog [None req-0338fc77-aede-436c-9a0d-2f02fc1bffbc tempest-ServerRescueNegativeTestJSON-509507797 tempest-ServerRescueNegativeTestJSON-509507797-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/27abe5af-8845-40e6-a9c3-12399369b117" status: 204 len: 0 microversion: 2.1 time: 0.143066 Apr 23 04:04:15 user devstack@n-api.service[61306]: [pid: 61306|app: 0|req: 131/397] 10.0.0.210 () {62 vars in 1316 bytes} [Sun Apr 23 04:04:15 2023] DELETE /compute/v2.1/servers/27abe5af-8845-40e6-a9c3-12399369b117 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 23 04:04:15 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi [None req-f763e6df-6f1f-421f-a58d-84d23a8d9dc6 tempest-ServerRescueNegativeTestJSON-509507797 tempest-ServerRescueNegativeTestJSON-509507797-project-member] Calling method '>' {{(pid=61308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 04:04:15 user devstack@n-api.service[61308]: DEBUG nova.compute.api [None req-f763e6df-6f1f-421f-a58d-84d23a8d9dc6 tempest-ServerRescueNegativeTestJSON-509507797 tempest-ServerRescueNegativeTestJSON-509507797-project-member] [instance: 27abe5af-8845-40e6-a9c3-12399369b117] Fetching instance by UUID {{(pid=61308) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 23 04:04:15 user devstack@n-api.service[61308]: DEBUG dbcounter [-] [61308] Writing DB stats nova_api:SELECT=2 {{(pid=61308) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 04:04:15 user devstack@n-api.service[61308]: DEBUG dbcounter [-] [61308] Writing DB stats nova_cell1:SELECT=6 {{(pid=61308) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 04:04:15 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-f763e6df-6f1f-421f-a58d-84d23a8d9dc6 tempest-ServerRescueNegativeTestJSON-509507797 tempest-ServerRescueNegativeTestJSON-509507797-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 04:04:15 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-f763e6df-6f1f-421f-a58d-84d23a8d9dc6 tempest-ServerRescueNegativeTestJSON-509507797 tempest-ServerRescueNegativeTestJSON-509507797-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 04:04:15 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-f763e6df-6f1f-421f-a58d-84d23a8d9dc6 tempest-ServerRescueNegativeTestJSON-509507797 tempest-ServerRescueNegativeTestJSON-509507797-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 04:04:15 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-f763e6df-6f1f-421f-a58d-84d23a8d9dc6 tempest-ServerRescueNegativeTestJSON-509507797 tempest-ServerRescueNegativeTestJSON-509507797-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 04:04:15 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-f763e6df-6f1f-421f-a58d-84d23a8d9dc6 tempest-ServerRescueNegativeTestJSON-509507797 tempest-ServerRescueNegativeTestJSON-509507797-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 04:04:15 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-f763e6df-6f1f-421f-a58d-84d23a8d9dc6 tempest-ServerRescueNegativeTestJSON-509507797 tempest-ServerRescueNegativeTestJSON-509507797-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 04:04:16 user devstack@n-api.service[61308]: DEBUG nova.policy [None req-f763e6df-6f1f-421f-a58d-84d23a8d9dc6 tempest-ServerRescueNegativeTestJSON-509507797 tempest-ServerRescueNegativeTestJSON-509507797-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b2f522c7164c5c934b8bbf113b542a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db4b7bdc478946e2ad0a2060b433b42c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61308) authorize /opt/stack/nova/nova/policy.py:203}} Apr 23 04:04:16 user devstack@n-api.service[61308]: INFO nova.api.openstack.requestlog [None req-f763e6df-6f1f-421f-a58d-84d23a8d9dc6 tempest-ServerRescueNegativeTestJSON-509507797 tempest-ServerRescueNegativeTestJSON-509507797-project-member] 10.0.0.210 "GET /compute/v2.1/servers/27abe5af-8845-40e6-a9c3-12399369b117" status: 200 len: 1510 microversion: 2.1 time: 0.236670 Apr 23 04:04:16 user devstack@n-api.service[61308]: [pid: 61308|app: 0|req: 135/398] 10.0.0.210 () {62 vars in 1313 bytes} [Sun Apr 23 04:04:15 2023] GET /compute/v2.1/servers/27abe5af-8845-40e6-a9c3-12399369b117 => generated 1510 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 23 04:04:16 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi [req-9b0ee0b8-ff45-44fa-b95b-136f49b2fad4 req-6af5f681-77a1-430a-bdd4-b10e012f3762 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27abe5af-8845-40e6-a9c3-12399369b117", "name": "network-vif-unplugged", "status": "completed", "tag": "85c6dc8b-d8a7-4df1-a8a5-667f7d80e42d"}]} {{(pid=61307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 04:04:16 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [req-9b0ee0b8-ff45-44fa-b95b-136f49b2fad4 req-6af5f681-77a1-430a-bdd4-b10e012f3762 service nova] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 04:04:16 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [req-9b0ee0b8-ff45-44fa-b95b-136f49b2fad4 req-6af5f681-77a1-430a-bdd4-b10e012f3762 service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 04:04:16 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [req-9b0ee0b8-ff45-44fa-b95b-136f49b2fad4 req-6af5f681-77a1-430a-bdd4-b10e012f3762 service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 04:04:16 user devstack@n-api.service[61307]: INFO nova.api.openstack.compute.server_external_events [req-9b0ee0b8-ff45-44fa-b95b-136f49b2fad4 req-6af5f681-77a1-430a-bdd4-b10e012f3762 service nova] Creating event network-vif-unplugged:85c6dc8b-d8a7-4df1-a8a5-667f7d80e42d for instance 27abe5af-8845-40e6-a9c3-12399369b117 on user Apr 23 04:04:16 user devstack@n-api.service[61307]: INFO nova.api.openstack.requestlog [req-9b0ee0b8-ff45-44fa-b95b-136f49b2fad4 req-6af5f681-77a1-430a-bdd4-b10e012f3762 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030984 Apr 23 04:04:16 user devstack@n-api.service[61307]: [pid: 61307|app: 0|req: 133/399] 10.0.0.210 () {68 vars in 1394 bytes} [Sun Apr 23 04:04:16 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 23 04:04:18 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi [req-104d64c3-e653-48dd-89ea-68134af1f562 req-85020bf0-87bf-4e21-8fe0-0b2751b167e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27abe5af-8845-40e6-a9c3-12399369b117", "name": "network-vif-plugged", "status": "completed", "tag": "85c6dc8b-d8a7-4df1-a8a5-667f7d80e42d"}, {"server_uuid": "27abe5af-8845-40e6-a9c3-12399369b117", "name": "network-vif-plugged", "status": "completed", "tag": "85c6dc8b-d8a7-4df1-a8a5-667f7d80e42d"}, {"server_uuid": "27abe5af-8845-40e6-a9c3-12399369b117", "name": "network-vif-plugged", "status": "completed", "tag": "85c6dc8b-d8a7-4df1-a8a5-667f7d80e42d"}, {"server_uuid": "27abe5af-8845-40e6-a9c3-12399369b117", "name": "network-vif-plugged", "status": "completed", "tag": "85c6dc8b-d8a7-4df1-a8a5-667f7d80e42d"}, {"server_uuid": "27abe5af-8845-40e6-a9c3-12399369b117", "name": "network-vif-deleted", "tag": "85c6dc8b-d8a7-4df1-a8a5-667f7d80e42d"}]} {{(pid=61306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 04:04:18 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [req-104d64c3-e653-48dd-89ea-68134af1f562 req-85020bf0-87bf-4e21-8fe0-0b2751b167e6 service nova] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 04:04:18 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [req-104d64c3-e653-48dd-89ea-68134af1f562 req-85020bf0-87bf-4e21-8fe0-0b2751b167e6 service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 04:04:18 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [req-104d64c3-e653-48dd-89ea-68134af1f562 req-85020bf0-87bf-4e21-8fe0-0b2751b167e6 service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 04:04:18 user devstack@n-api.service[61306]: INFO nova.api.openstack.compute.server_external_events [req-104d64c3-e653-48dd-89ea-68134af1f562 req-85020bf0-87bf-4e21-8fe0-0b2751b167e6 service nova] Creating event network-vif-plugged:85c6dc8b-d8a7-4df1-a8a5-667f7d80e42d for instance 27abe5af-8845-40e6-a9c3-12399369b117 on user Apr 23 04:04:18 user devstack@n-api.service[61306]: INFO nova.api.openstack.compute.server_external_events [req-104d64c3-e653-48dd-89ea-68134af1f562 req-85020bf0-87bf-4e21-8fe0-0b2751b167e6 service nova] Creating event network-vif-plugged:85c6dc8b-d8a7-4df1-a8a5-667f7d80e42d for instance 27abe5af-8845-40e6-a9c3-12399369b117 on user Apr 23 04:04:18 user devstack@n-api.service[61306]: INFO nova.api.openstack.compute.server_external_events [req-104d64c3-e653-48dd-89ea-68134af1f562 req-85020bf0-87bf-4e21-8fe0-0b2751b167e6 service nova] Creating event network-vif-plugged:85c6dc8b-d8a7-4df1-a8a5-667f7d80e42d for instance 27abe5af-8845-40e6-a9c3-12399369b117 on user Apr 23 04:04:18 user devstack@n-api.service[61306]: INFO nova.api.openstack.compute.server_external_events [req-104d64c3-e653-48dd-89ea-68134af1f562 req-85020bf0-87bf-4e21-8fe0-0b2751b167e6 service nova] Creating event network-vif-plugged:85c6dc8b-d8a7-4df1-a8a5-667f7d80e42d for instance 27abe5af-8845-40e6-a9c3-12399369b117 on user Apr 23 04:04:18 user devstack@n-api.service[61306]: INFO nova.api.openstack.compute.server_external_events [req-104d64c3-e653-48dd-89ea-68134af1f562 req-85020bf0-87bf-4e21-8fe0-0b2751b167e6 service nova] Creating event network-vif-deleted:85c6dc8b-d8a7-4df1-a8a5-667f7d80e42d for instance 27abe5af-8845-40e6-a9c3-12399369b117 on user Apr 23 04:04:18 user devstack@n-api.service[61306]: INFO nova.api.openstack.requestlog [req-104d64c3-e653-48dd-89ea-68134af1f562 req-85020bf0-87bf-4e21-8fe0-0b2751b167e6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 867 microversion: 2.1 time: 0.031305 Apr 23 04:04:18 user devstack@n-api.service[61306]: [pid: 61306|app: 0|req: 132/400] 10.0.0.210 () {68 vars in 1394 bytes} [Sun Apr 23 04:04:18 2023] POST /compute/v2.1/os-server-external-events => generated 867 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 23 04:04:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi [None req-65e646c8-d00b-4cfb-80a5-a7b158aca52c tempest-ServersNegativeTestJSON-1115615559 tempest-ServersNegativeTestJSON-1115615559-project-member] Calling method '>' {{(pid=61308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 04:04:57 user devstack@n-api.service[61308]: DEBUG nova.compute.api [None req-65e646c8-d00b-4cfb-80a5-a7b158aca52c tempest-ServersNegativeTestJSON-1115615559 tempest-ServersNegativeTestJSON-1115615559-project-member] [instance: 994da665-4a5f-41ce-a104-febce8be2557] Fetching instance by UUID {{(pid=61308) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 23 04:04:57 user devstack@n-api.service[61308]: DEBUG dbcounter [-] [61308] Writing DB stats nova_api:SELECT=2 {{(pid=61308) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 04:04:57 user devstack@n-api.service[61308]: DEBUG dbcounter [-] [61308] Writing DB stats nova_cell1:SELECT=6 {{(pid=61308) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 04:04:57 user devstack@n-api.service[61308]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 23 04:04:57 user devstack@n-api.service[61308]: Sun Apr 23 04:04:57 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/994da665-4a5f-41ce-a104-febce8be2557 (ip 10.0.0.210) !!! Apr 23 04:04:57 user devstack@n-api.service[61308]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 23 04:04:57 user devstack@n-api.service[61308]: Sun Apr 23 04:04:57 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/994da665-4a5f-41ce-a104-febce8be2557 (ip 10.0.0.210) !!! Apr 23 04:04:57 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-65e646c8-d00b-4cfb-80a5-a7b158aca52c tempest-ServersNegativeTestJSON-1115615559 tempest-ServersNegativeTestJSON-1115615559-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 04:04:57 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-65e646c8-d00b-4cfb-80a5-a7b158aca52c tempest-ServersNegativeTestJSON-1115615559 tempest-ServersNegativeTestJSON-1115615559-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 04:04:57 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-65e646c8-d00b-4cfb-80a5-a7b158aca52c tempest-ServersNegativeTestJSON-1115615559 tempest-ServersNegativeTestJSON-1115615559-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 04:04:57 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-65e646c8-d00b-4cfb-80a5-a7b158aca52c tempest-ServersNegativeTestJSON-1115615559 tempest-ServersNegativeTestJSON-1115615559-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 04:04:57 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-65e646c8-d00b-4cfb-80a5-a7b158aca52c tempest-ServersNegativeTestJSON-1115615559 tempest-ServersNegativeTestJSON-1115615559-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 04:04:57 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-65e646c8-d00b-4cfb-80a5-a7b158aca52c tempest-ServersNegativeTestJSON-1115615559 tempest-ServersNegativeTestJSON-1115615559-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 04:04:57 user devstack@n-api.service[61308]: INFO nova.api.openstack.wsgi [None req-65e646c8-d00b-4cfb-80a5-a7b158aca52c tempest-ServersNegativeTestJSON-1115615559 tempest-ServersNegativeTestJSON-1115615559-project-member] HTTP exception thrown: Instance 994da665-4a5f-41ce-a104-febce8be2557 could not be found. Apr 23 04:04:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi [None req-65e646c8-d00b-4cfb-80a5-a7b158aca52c tempest-ServersNegativeTestJSON-1115615559 tempest-ServersNegativeTestJSON-1115615559-project-member] Request method failure captured: Apr 23 04:04:57 user devstack@n-api.service[61308]: request: DELETE /compute/v2.1/servers/994da665-4a5f-41ce-a104-febce8be2557 HTTP/1.1 Apr 23 04:04:57 user devstack@n-api.service[61308]: Accept: application/json Apr 23 04:04:57 user devstack@n-api.service[61308]: Accept-Encoding: identity Apr 23 04:04:57 user devstack@n-api.service[61308]: Connection: close Apr 23 04:04:57 user devstack@n-api.service[61308]: Content-Length: 0 Apr 23 04:04:57 user devstack@n-api.service[61308]: Content-Type: application/json Apr 23 04:04:57 user devstack@n-api.service[61308]: Host: 10.0.0.210 Apr 23 04:04:57 user devstack@n-api.service[61308]: Openstack-System-Scope: None Apr 23 04:04:57 user devstack@n-api.service[61308]: User-Agent: python-urllib3/1.26.15 Apr 23 04:04:57 user devstack@n-api.service[61308]: X-Auth-Token: gAAAAABkRKxjEhCjoNMqtLhu2RxdK5iis_mOy1m1OhYgEHq1hqZgaDN8nyVa42IgLK3MeaWhPhYnxfP3I5ZsEj0up2VGTAfJAsexVojvTvodGrsXaEkQKlVj5_rGG_Fhan4XJMitnwDyPDaY7kHeCRdEkSPEhUCq-5gRNlv5HuvOmo51IwGtFWM Apr 23 04:04:57 user devstack@n-api.service[61308]: X-Domain-Id: None Apr 23 04:04:57 user devstack@n-api.service[61308]: X-Domain-Name: None Apr 23 04:04:57 user devstack@n-api.service[61308]: X-Identity-Status: Confirmed Apr 23 04:04:57 user devstack@n-api.service[61308]: X-Is-Admin-Project: True Apr 23 04:04:57 user devstack@n-api.service[61308]: X-Project-Domain-Id: default Apr 23 04:04:57 user devstack@n-api.service[61308]: X-Project-Domain-Name: Default Apr 23 04:04:57 user devstack@n-api.service[61308]: X-Project-Id: 39d6cb4cfcb2413f8039ee9febf1c046 Apr 23 04:04:57 user devstack@n-api.service[61308]: X-Project-Name: tempest-ServersNegativeTestJSON-1115615559 Apr 23 04:04:57 user devstack@n-api.service[61308]: X-Role: reader,member Apr 23 04:04:57 user devstack@n-api.service[61308]: X-Roles: reader,member Apr 23 04:04:57 user devstack@n-api.service[61308]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/39d6cb4cfcb2413f8039ee9febf1c046"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/39d6cb4cfcb2413f8039ee9febf1c046"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/39d6cb4cfcb2413f8039ee9febf1c046"}]}] Apr 23 04:04:57 user devstack@n-api.service[61308]: X-Tenant: tempest-ServersNegativeTestJSON-1115615559 Apr 23 04:04:57 user devstack@n-api.service[61308]: X-Tenant-Id: 39d6cb4cfcb2413f8039ee9febf1c046 Apr 23 04:04:57 user devstack@n-api.service[61308]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1115615559 Apr 23 04:04:57 user devstack@n-api.service[61308]: X-User: tempest-ServersNegativeTestJSON-1115615559-project-member Apr 23 04:04:57 user devstack@n-api.service[61308]: X-User-Domain-Id: default Apr 23 04:04:57 user devstack@n-api.service[61308]: X-User-Domain-Name: Default Apr 23 04:04:57 user devstack@n-api.service[61308]: X-User-Id: 45d9ae4a3b00492fa2fc16a22a34df09 Apr 23 04:04:57 user devstack@n-api.service[61308]: X-User-Name: tempest-ServersNegativeTestJSON-1115615559-project-member Apr 23 04:04:57 user devstack@n-api.service[61308]: method: > Apr 23 04:04:57 user devstack@n-api.service[61308]: exception: Instance 994da665-4a5f-41ce-a104-febce8be2557 could not be found. Apr 23 04:04:57 user devstack@n-api.service[61308]: action_args: {'id': '994da665-4a5f-41ce-a104-febce8be2557'} Apr 23 04:04:57 user devstack@n-api.service[61308]: {{(pid=61308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 23 04:04:57 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 23 04:04:57 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 23 04:04:57 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 23 04:04:57 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 23 04:04:57 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 23 04:04:57 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 23 04:04:57 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 23 04:04:57 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 23 04:04:57 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 23 04:04:57 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 994da665-4a5f-41ce-a104-febce8be2557 could not be found. Apr 23 04:04:57 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi Apr 23 04:04:57 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 23 04:04:57 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi Apr 23 04:04:57 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 23 04:04:57 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 23 04:04:57 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 23 04:04:57 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 23 04:04:57 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 23 04:04:57 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 23 04:04:57 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 23 04:04:57 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 23 04:04:57 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 23 04:04:57 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 23 04:04:57 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 23 04:04:57 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 23 04:04:57 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 23 04:04:57 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 23 04:04:57 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 23 04:04:57 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 994da665-4a5f-41ce-a104-febce8be2557 could not be found. Apr 23 04:04:57 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi Apr 23 04:04:57 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 23 04:04:57 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi Apr 23 04:04:57 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 23 04:04:57 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 23 04:04:57 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 23 04:04:57 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 23 04:04:57 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 23 04:04:57 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 994da665-4a5f-41ce-a104-febce8be2557 could not be found. Apr 23 04:04:57 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi Apr 23 04:04:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi [None req-65e646c8-d00b-4cfb-80a5-a7b158aca52c tempest-ServersNegativeTestJSON-1115615559 tempest-ServersNegativeTestJSON-1115615559-project-member] Returning 404 to user: Instance 994da665-4a5f-41ce-a104-febce8be2557 could not be found. {{(pid=61308) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 23 04:04:57 user devstack@n-api.service[61308]: INFO nova.api.openstack.requestlog [None req-65e646c8-d00b-4cfb-80a5-a7b158aca52c tempest-ServersNegativeTestJSON-1115615559 tempest-ServersNegativeTestJSON-1115615559-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/994da665-4a5f-41ce-a104-febce8be2557" status: 404 len: 111 microversion: 2.1 time: 0.041032 Apr 23 04:04:57 user devstack@n-api.service[61308]: [pid: 61308|app: 0|req: 136/401] 10.0.0.210 () {62 vars in 1316 bytes} [Sun Apr 23 04:04:57 2023] DELETE /compute/v2.1/servers/994da665-4a5f-41ce-a104-febce8be2557 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 23 04:04:57 user devstack@n-api.service[61307]: DEBUG dbcounter [-] [61307] Writing DB stats nova_api:SELECT=4 {{(pid=61307) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 04:04:57 user devstack@n-api.service[61307]: DEBUG dbcounter [-] [61307] Writing DB stats nova_cell1:SELECT=4 {{(pid=61307) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 04:04:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi [None req-585136c6-47c2-4aec-a02f-dfbc76c1ca38 tempest-ServersNegativeTestJSON-1115615559 tempest-ServersNegativeTestJSON-1115615559-project-member] Calling method '>' {{(pid=61307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 04:04:57 user devstack@n-api.service[61307]: DEBUG nova.compute.api [None req-585136c6-47c2-4aec-a02f-dfbc76c1ca38 tempest-ServersNegativeTestJSON-1115615559 tempest-ServersNegativeTestJSON-1115615559-project-member] [instance: 994da665-4a5f-41ce-a104-febce8be2557] Fetching instance by UUID {{(pid=61307) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 23 04:04:57 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-585136c6-47c2-4aec-a02f-dfbc76c1ca38 tempest-ServersNegativeTestJSON-1115615559 tempest-ServersNegativeTestJSON-1115615559-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 04:04:57 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-585136c6-47c2-4aec-a02f-dfbc76c1ca38 tempest-ServersNegativeTestJSON-1115615559 tempest-ServersNegativeTestJSON-1115615559-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 04:04:57 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-585136c6-47c2-4aec-a02f-dfbc76c1ca38 tempest-ServersNegativeTestJSON-1115615559 tempest-ServersNegativeTestJSON-1115615559-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 04:04:57 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-585136c6-47c2-4aec-a02f-dfbc76c1ca38 tempest-ServersNegativeTestJSON-1115615559 tempest-ServersNegativeTestJSON-1115615559-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 04:04:57 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-585136c6-47c2-4aec-a02f-dfbc76c1ca38 tempest-ServersNegativeTestJSON-1115615559 tempest-ServersNegativeTestJSON-1115615559-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 04:04:57 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-585136c6-47c2-4aec-a02f-dfbc76c1ca38 tempest-ServersNegativeTestJSON-1115615559 tempest-ServersNegativeTestJSON-1115615559-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 04:04:57 user devstack@n-api.service[61307]: INFO nova.api.openstack.wsgi [None req-585136c6-47c2-4aec-a02f-dfbc76c1ca38 tempest-ServersNegativeTestJSON-1115615559 tempest-ServersNegativeTestJSON-1115615559-project-member] HTTP exception thrown: Instance 994da665-4a5f-41ce-a104-febce8be2557 could not be found. Apr 23 04:04:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi [None req-585136c6-47c2-4aec-a02f-dfbc76c1ca38 tempest-ServersNegativeTestJSON-1115615559 tempest-ServersNegativeTestJSON-1115615559-project-member] Request method failure captured: Apr 23 04:04:57 user devstack@n-api.service[61307]: request: GET /compute/v2.1/servers/994da665-4a5f-41ce-a104-febce8be2557 HTTP/1.1 Apr 23 04:04:57 user devstack@n-api.service[61307]: Accept: application/json Apr 23 04:04:57 user devstack@n-api.service[61307]: Accept-Encoding: identity Apr 23 04:04:57 user devstack@n-api.service[61307]: Connection: close Apr 23 04:04:57 user devstack@n-api.service[61307]: Content-Length: 0 Apr 23 04:04:57 user devstack@n-api.service[61307]: Content-Type: application/json Apr 23 04:04:57 user devstack@n-api.service[61307]: Host: 10.0.0.210 Apr 23 04:04:57 user devstack@n-api.service[61307]: Openstack-System-Scope: None Apr 23 04:04:57 user devstack@n-api.service[61307]: User-Agent: python-urllib3/1.26.15 Apr 23 04:04:57 user devstack@n-api.service[61307]: X-Auth-Token: gAAAAABkRKxjEhCjoNMqtLhu2RxdK5iis_mOy1m1OhYgEHq1hqZgaDN8nyVa42IgLK3MeaWhPhYnxfP3I5ZsEj0up2VGTAfJAsexVojvTvodGrsXaEkQKlVj5_rGG_Fhan4XJMitnwDyPDaY7kHeCRdEkSPEhUCq-5gRNlv5HuvOmo51IwGtFWM Apr 23 04:04:57 user devstack@n-api.service[61307]: X-Domain-Id: None Apr 23 04:04:57 user devstack@n-api.service[61307]: X-Domain-Name: None Apr 23 04:04:57 user devstack@n-api.service[61307]: X-Identity-Status: Confirmed Apr 23 04:04:57 user devstack@n-api.service[61307]: X-Is-Admin-Project: True Apr 23 04:04:57 user devstack@n-api.service[61307]: X-Project-Domain-Id: default Apr 23 04:04:57 user devstack@n-api.service[61307]: X-Project-Domain-Name: Default Apr 23 04:04:57 user devstack@n-api.service[61307]: X-Project-Id: 39d6cb4cfcb2413f8039ee9febf1c046 Apr 23 04:04:57 user devstack@n-api.service[61307]: X-Project-Name: tempest-ServersNegativeTestJSON-1115615559 Apr 23 04:04:57 user devstack@n-api.service[61307]: X-Role: reader,member Apr 23 04:04:57 user devstack@n-api.service[61307]: X-Roles: reader,member Apr 23 04:04:57 user devstack@n-api.service[61307]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/39d6cb4cfcb2413f8039ee9febf1c046"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/39d6cb4cfcb2413f8039ee9febf1c046"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/39d6cb4cfcb2413f8039ee9febf1c046"}]}] Apr 23 04:04:57 user devstack@n-api.service[61307]: X-Tenant: tempest-ServersNegativeTestJSON-1115615559 Apr 23 04:04:57 user devstack@n-api.service[61307]: X-Tenant-Id: 39d6cb4cfcb2413f8039ee9febf1c046 Apr 23 04:04:57 user devstack@n-api.service[61307]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1115615559 Apr 23 04:04:57 user devstack@n-api.service[61307]: X-User: tempest-ServersNegativeTestJSON-1115615559-project-member Apr 23 04:04:57 user devstack@n-api.service[61307]: X-User-Domain-Id: default Apr 23 04:04:57 user devstack@n-api.service[61307]: X-User-Domain-Name: Default Apr 23 04:04:57 user devstack@n-api.service[61307]: X-User-Id: 45d9ae4a3b00492fa2fc16a22a34df09 Apr 23 04:04:57 user devstack@n-api.service[61307]: X-User-Name: tempest-ServersNegativeTestJSON-1115615559-project-member Apr 23 04:04:57 user devstack@n-api.service[61307]: method: > Apr 23 04:04:57 user devstack@n-api.service[61307]: exception: Instance 994da665-4a5f-41ce-a104-febce8be2557 could not be found. Apr 23 04:04:57 user devstack@n-api.service[61307]: action_args: {'id': '994da665-4a5f-41ce-a104-febce8be2557'} Apr 23 04:04:57 user devstack@n-api.service[61307]: {{(pid=61307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 23 04:04:57 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 23 04:04:57 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 23 04:04:57 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 23 04:04:57 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 23 04:04:57 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 23 04:04:57 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 23 04:04:57 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 23 04:04:57 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 23 04:04:57 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 23 04:04:57 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 994da665-4a5f-41ce-a104-febce8be2557 could not be found. Apr 23 04:04:57 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi Apr 23 04:04:57 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 23 04:04:57 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi Apr 23 04:04:57 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 23 04:04:57 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 23 04:04:57 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 23 04:04:57 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 23 04:04:57 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 23 04:04:57 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 23 04:04:57 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 23 04:04:57 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 23 04:04:57 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 23 04:04:57 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 23 04:04:57 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 23 04:04:57 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 23 04:04:57 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 23 04:04:57 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 994da665-4a5f-41ce-a104-febce8be2557 could not be found. Apr 23 04:04:57 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi Apr 23 04:04:57 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 23 04:04:57 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi Apr 23 04:04:57 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 23 04:04:57 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 23 04:04:57 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 23 04:04:57 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 23 04:04:57 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 23 04:04:57 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 994da665-4a5f-41ce-a104-febce8be2557 could not be found. Apr 23 04:04:57 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi Apr 23 04:04:57 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi [None req-585136c6-47c2-4aec-a02f-dfbc76c1ca38 tempest-ServersNegativeTestJSON-1115615559 tempest-ServersNegativeTestJSON-1115615559-project-member] Returning 404 to user: Instance 994da665-4a5f-41ce-a104-febce8be2557 could not be found. {{(pid=61307) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 23 04:04:57 user devstack@n-api.service[61307]: INFO nova.api.openstack.requestlog [None req-585136c6-47c2-4aec-a02f-dfbc76c1ca38 tempest-ServersNegativeTestJSON-1115615559 tempest-ServersNegativeTestJSON-1115615559-project-member] 10.0.0.210 "GET /compute/v2.1/servers/994da665-4a5f-41ce-a104-febce8be2557" status: 404 len: 111 microversion: 2.1 time: 0.035622 Apr 23 04:04:57 user devstack@n-api.service[61307]: [pid: 61307|app: 0|req: 134/402] 10.0.0.210 () {62 vars in 1313 bytes} [Sun Apr 23 04:04:57 2023] GET /compute/v2.1/servers/994da665-4a5f-41ce-a104-febce8be2557 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 23 04:04:57 user devstack@n-api.service[61306]: DEBUG dbcounter [-] [61306] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61306) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 04:04:57 user devstack@n-api.service[61306]: DEBUG dbcounter [-] [61306] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61306) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 04:04:57 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi [None req-b6769401-d9f8-4e3a-99a4-1f8adf77fc4c tempest-ServersNegativeTestJSON-1115615559 tempest-ServersNegativeTestJSON-1115615559-project-member] Calling method '>' {{(pid=61306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 04:04:57 user devstack@n-api.service[61306]: DEBUG nova.compute.api [None req-b6769401-d9f8-4e3a-99a4-1f8adf77fc4c tempest-ServersNegativeTestJSON-1115615559 tempest-ServersNegativeTestJSON-1115615559-project-member] [instance: ee89a9d5-0507-475c-bea2-e02e34d15710] Fetching instance by UUID {{(pid=61306) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 23 04:04:57 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-b6769401-d9f8-4e3a-99a4-1f8adf77fc4c tempest-ServersNegativeTestJSON-1115615559 tempest-ServersNegativeTestJSON-1115615559-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 04:04:57 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-b6769401-d9f8-4e3a-99a4-1f8adf77fc4c tempest-ServersNegativeTestJSON-1115615559 tempest-ServersNegativeTestJSON-1115615559-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 04:04:57 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-b6769401-d9f8-4e3a-99a4-1f8adf77fc4c tempest-ServersNegativeTestJSON-1115615559 tempest-ServersNegativeTestJSON-1115615559-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 04:04:57 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-b6769401-d9f8-4e3a-99a4-1f8adf77fc4c tempest-ServersNegativeTestJSON-1115615559 tempest-ServersNegativeTestJSON-1115615559-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 04:04:57 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-b6769401-d9f8-4e3a-99a4-1f8adf77fc4c tempest-ServersNegativeTestJSON-1115615559 tempest-ServersNegativeTestJSON-1115615559-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 04:04:57 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-b6769401-d9f8-4e3a-99a4-1f8adf77fc4c tempest-ServersNegativeTestJSON-1115615559 tempest-ServersNegativeTestJSON-1115615559-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 04:04:57 user devstack@n-api.service[61306]: DEBUG nova.compute.api [None req-b6769401-d9f8-4e3a-99a4-1f8adf77fc4c tempest-ServersNegativeTestJSON-1115615559 tempest-ServersNegativeTestJSON-1115615559-project-member] [instance: ee89a9d5-0507-475c-bea2-e02e34d15710] Going to try to terminate instance {{(pid=61306) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 23 04:04:57 user devstack@n-api.service[61306]: INFO nova.api.openstack.requestlog [None req-b6769401-d9f8-4e3a-99a4-1f8adf77fc4c tempest-ServersNegativeTestJSON-1115615559 tempest-ServersNegativeTestJSON-1115615559-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/ee89a9d5-0507-475c-bea2-e02e34d15710" status: 204 len: 0 microversion: 2.1 time: 0.135818 Apr 23 04:04:57 user devstack@n-api.service[61306]: [pid: 61306|app: 0|req: 133/403] 10.0.0.210 () {62 vars in 1316 bytes} [Sun Apr 23 04:04:57 2023] DELETE /compute/v2.1/servers/ee89a9d5-0507-475c-bea2-e02e34d15710 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 23 04:04:57 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi [None req-2df39fe8-a7bc-4b90-b469-7cce23eb26e2 tempest-ServersNegativeTestJSON-1115615559 tempest-ServersNegativeTestJSON-1115615559-project-member] Calling method '>' {{(pid=61308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 04:04:57 user devstack@n-api.service[61308]: DEBUG nova.compute.api [None req-2df39fe8-a7bc-4b90-b469-7cce23eb26e2 tempest-ServersNegativeTestJSON-1115615559 tempest-ServersNegativeTestJSON-1115615559-project-member] [instance: ee89a9d5-0507-475c-bea2-e02e34d15710] Fetching instance by UUID {{(pid=61308) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 23 04:04:57 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-2df39fe8-a7bc-4b90-b469-7cce23eb26e2 tempest-ServersNegativeTestJSON-1115615559 tempest-ServersNegativeTestJSON-1115615559-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 04:04:57 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-2df39fe8-a7bc-4b90-b469-7cce23eb26e2 tempest-ServersNegativeTestJSON-1115615559 tempest-ServersNegativeTestJSON-1115615559-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 04:04:57 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-2df39fe8-a7bc-4b90-b469-7cce23eb26e2 tempest-ServersNegativeTestJSON-1115615559 tempest-ServersNegativeTestJSON-1115615559-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 04:04:57 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-2df39fe8-a7bc-4b90-b469-7cce23eb26e2 tempest-ServersNegativeTestJSON-1115615559 tempest-ServersNegativeTestJSON-1115615559-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 04:04:57 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-2df39fe8-a7bc-4b90-b469-7cce23eb26e2 tempest-ServersNegativeTestJSON-1115615559 tempest-ServersNegativeTestJSON-1115615559-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 04:04:57 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-2df39fe8-a7bc-4b90-b469-7cce23eb26e2 tempest-ServersNegativeTestJSON-1115615559 tempest-ServersNegativeTestJSON-1115615559-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 04:04:58 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi [req-a93e5c6e-b07c-40bc-b330-896e0ca0f0f0 req-4fe71157-d01f-440b-8e52-265bf1e62f75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee89a9d5-0507-475c-bea2-e02e34d15710", "name": "network-vif-unplugged", "status": "completed", "tag": "8948ed3a-de42-41ef-b7ca-c34a2d405b09"}]} {{(pid=61307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 04:04:58 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [req-a93e5c6e-b07c-40bc-b330-896e0ca0f0f0 req-4fe71157-d01f-440b-8e52-265bf1e62f75 service nova] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 04:04:58 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [req-a93e5c6e-b07c-40bc-b330-896e0ca0f0f0 req-4fe71157-d01f-440b-8e52-265bf1e62f75 service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 04:04:58 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [req-a93e5c6e-b07c-40bc-b330-896e0ca0f0f0 req-4fe71157-d01f-440b-8e52-265bf1e62f75 service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 04:04:58 user devstack@n-api.service[61307]: INFO nova.api.openstack.compute.server_external_events [req-a93e5c6e-b07c-40bc-b330-896e0ca0f0f0 req-4fe71157-d01f-440b-8e52-265bf1e62f75 service nova] Creating event network-vif-unplugged:8948ed3a-de42-41ef-b7ca-c34a2d405b09 for instance ee89a9d5-0507-475c-bea2-e02e34d15710 on user Apr 23 04:04:58 user devstack@n-api.service[61308]: DEBUG nova.policy [None req-2df39fe8-a7bc-4b90-b469-7cce23eb26e2 tempest-ServersNegativeTestJSON-1115615559 tempest-ServersNegativeTestJSON-1115615559-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d9ae4a3b00492fa2fc16a22a34df09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39d6cb4cfcb2413f8039ee9febf1c046', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61308) authorize /opt/stack/nova/nova/policy.py:203}} Apr 23 04:04:58 user devstack@n-api.service[61307]: INFO nova.api.openstack.requestlog [req-a93e5c6e-b07c-40bc-b330-896e0ca0f0f0 req-4fe71157-d01f-440b-8e52-265bf1e62f75 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047430 Apr 23 04:04:58 user devstack@n-api.service[61307]: [pid: 61307|app: 0|req: 135/404] 10.0.0.210 () {68 vars in 1394 bytes} [Sun Apr 23 04:04:58 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 23 04:04:58 user devstack@n-api.service[61308]: INFO nova.api.openstack.requestlog [None req-2df39fe8-a7bc-4b90-b469-7cce23eb26e2 tempest-ServersNegativeTestJSON-1115615559 tempest-ServersNegativeTestJSON-1115615559-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ee89a9d5-0507-475c-bea2-e02e34d15710" status: 200 len: 1501 microversion: 2.1 time: 0.272220 Apr 23 04:04:58 user devstack@n-api.service[61308]: [pid: 61308|app: 0|req: 137/405] 10.0.0.210 () {62 vars in 1313 bytes} [Sun Apr 23 04:04:57 2023] GET /compute/v2.1/servers/ee89a9d5-0507-475c-bea2-e02e34d15710 => generated 1501 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 23 04:05:00 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi [req-0d09e7ee-c2ea-46c1-ab96-5f0d5a77e27d req-077439ed-062d-44c5-a6e8-b398d29a6393 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee89a9d5-0507-475c-bea2-e02e34d15710", "name": "network-vif-plugged", "status": "completed", "tag": "8948ed3a-de42-41ef-b7ca-c34a2d405b09"}, {"server_uuid": "ee89a9d5-0507-475c-bea2-e02e34d15710", "name": "network-vif-deleted", "tag": "8948ed3a-de42-41ef-b7ca-c34a2d405b09"}]} {{(pid=61306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 04:05:00 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [req-0d09e7ee-c2ea-46c1-ab96-5f0d5a77e27d req-077439ed-062d-44c5-a6e8-b398d29a6393 service nova] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 04:05:00 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [req-0d09e7ee-c2ea-46c1-ab96-5f0d5a77e27d req-077439ed-062d-44c5-a6e8-b398d29a6393 service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 04:05:00 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [req-0d09e7ee-c2ea-46c1-ab96-5f0d5a77e27d req-077439ed-062d-44c5-a6e8-b398d29a6393 service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 04:05:00 user devstack@n-api.service[61306]: INFO nova.api.openstack.compute.server_external_events [req-0d09e7ee-c2ea-46c1-ab96-5f0d5a77e27d req-077439ed-062d-44c5-a6e8-b398d29a6393 service nova] Creating event network-vif-plugged:8948ed3a-de42-41ef-b7ca-c34a2d405b09 for instance ee89a9d5-0507-475c-bea2-e02e34d15710 on user Apr 23 04:05:00 user devstack@n-api.service[61306]: INFO nova.api.openstack.compute.server_external_events [req-0d09e7ee-c2ea-46c1-ab96-5f0d5a77e27d req-077439ed-062d-44c5-a6e8-b398d29a6393 service nova] Creating event network-vif-deleted:8948ed3a-de42-41ef-b7ca-c34a2d405b09 for instance ee89a9d5-0507-475c-bea2-e02e34d15710 on user Apr 23 04:05:00 user devstack@n-api.service[61306]: INFO nova.api.openstack.requestlog [req-0d09e7ee-c2ea-46c1-ab96-5f0d5a77e27d req-077439ed-062d-44c5-a6e8-b398d29a6393 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.030556 Apr 23 04:05:00 user devstack@n-api.service[61306]: [pid: 61306|app: 0|req: 134/406] 10.0.0.210 () {68 vars in 1394 bytes} [Sun Apr 23 04:05:00 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 23 04:05:06 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi [None req-663c37d0-3e68-4a47-8a3b-34098dcaa5a6 tempest-ServerRescueNegativeTestJSON-509507797 tempest-ServerRescueNegativeTestJSON-509507797-project-member] Calling method '>' {{(pid=61307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 04:05:06 user devstack@n-api.service[61307]: DEBUG nova.compute.api [None req-663c37d0-3e68-4a47-8a3b-34098dcaa5a6 tempest-ServerRescueNegativeTestJSON-509507797 tempest-ServerRescueNegativeTestJSON-509507797-project-member] [instance: 27abe5af-8845-40e6-a9c3-12399369b117] Fetching instance by UUID {{(pid=61307) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 23 04:05:06 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-663c37d0-3e68-4a47-8a3b-34098dcaa5a6 tempest-ServerRescueNegativeTestJSON-509507797 tempest-ServerRescueNegativeTestJSON-509507797-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 04:05:06 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-663c37d0-3e68-4a47-8a3b-34098dcaa5a6 tempest-ServerRescueNegativeTestJSON-509507797 tempest-ServerRescueNegativeTestJSON-509507797-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 04:05:06 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-663c37d0-3e68-4a47-8a3b-34098dcaa5a6 tempest-ServerRescueNegativeTestJSON-509507797 tempest-ServerRescueNegativeTestJSON-509507797-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 04:05:06 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-663c37d0-3e68-4a47-8a3b-34098dcaa5a6 tempest-ServerRescueNegativeTestJSON-509507797 tempest-ServerRescueNegativeTestJSON-509507797-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 04:05:06 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-663c37d0-3e68-4a47-8a3b-34098dcaa5a6 tempest-ServerRescueNegativeTestJSON-509507797 tempest-ServerRescueNegativeTestJSON-509507797-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 04:05:06 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-663c37d0-3e68-4a47-8a3b-34098dcaa5a6 tempest-ServerRescueNegativeTestJSON-509507797 tempest-ServerRescueNegativeTestJSON-509507797-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 04:05:06 user devstack@n-api.service[61307]: INFO nova.api.openstack.wsgi [None req-663c37d0-3e68-4a47-8a3b-34098dcaa5a6 tempest-ServerRescueNegativeTestJSON-509507797 tempest-ServerRescueNegativeTestJSON-509507797-project-member] HTTP exception thrown: Instance 27abe5af-8845-40e6-a9c3-12399369b117 could not be found. Apr 23 04:05:06 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi [None req-663c37d0-3e68-4a47-8a3b-34098dcaa5a6 tempest-ServerRescueNegativeTestJSON-509507797 tempest-ServerRescueNegativeTestJSON-509507797-project-member] Request method failure captured: Apr 23 04:05:06 user devstack@n-api.service[61307]: request: GET /compute/v2.1/servers/27abe5af-8845-40e6-a9c3-12399369b117 HTTP/1.1 Apr 23 04:05:06 user devstack@n-api.service[61307]: Accept: application/json Apr 23 04:05:06 user devstack@n-api.service[61307]: Accept-Encoding: identity Apr 23 04:05:06 user devstack@n-api.service[61307]: Connection: close Apr 23 04:05:06 user devstack@n-api.service[61307]: Content-Length: 0 Apr 23 04:05:06 user devstack@n-api.service[61307]: Content-Type: application/json Apr 23 04:05:06 user devstack@n-api.service[61307]: Host: 10.0.0.210 Apr 23 04:05:06 user devstack@n-api.service[61307]: Openstack-System-Scope: None Apr 23 04:05:06 user devstack@n-api.service[61307]: User-Agent: python-urllib3/1.26.15 Apr 23 04:05:06 user devstack@n-api.service[61307]: X-Auth-Token: gAAAAABkRKzufIl90mvkTctwBYIOp6FDUjerVEPjISvtBVYkfxaQKagt3sixvQ2X9nugU2JfiELh_bn6alNo2PD3zQ0SmgpseWTrvEBta1ov6u7fHq7rVsbYzjHvO5N-_9jhESBttWSnjWvgQHfxf1X2jM11jS5lfPyXtTILzIL478uVWCL4pEs Apr 23 04:05:06 user devstack@n-api.service[61307]: X-Domain-Id: None Apr 23 04:05:06 user devstack@n-api.service[61307]: X-Domain-Name: None Apr 23 04:05:06 user devstack@n-api.service[61307]: X-Identity-Status: Confirmed Apr 23 04:05:06 user devstack@n-api.service[61307]: X-Is-Admin-Project: True Apr 23 04:05:06 user devstack@n-api.service[61307]: X-Project-Domain-Id: default Apr 23 04:05:06 user devstack@n-api.service[61307]: X-Project-Domain-Name: Default Apr 23 04:05:06 user devstack@n-api.service[61307]: X-Project-Id: db4b7bdc478946e2ad0a2060b433b42c Apr 23 04:05:06 user devstack@n-api.service[61307]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-509507797 Apr 23 04:05:06 user devstack@n-api.service[61307]: X-Role: reader,member Apr 23 04:05:06 user devstack@n-api.service[61307]: X-Roles: reader,member Apr 23 04:05:06 user devstack@n-api.service[61307]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/db4b7bdc478946e2ad0a2060b433b42c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/db4b7bdc478946e2ad0a2060b433b42c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/db4b7bdc478946e2ad0a2060b433b42c"}]}] Apr 23 04:05:06 user devstack@n-api.service[61307]: X-Tenant: tempest-ServerRescueNegativeTestJSON-509507797 Apr 23 04:05:06 user devstack@n-api.service[61307]: X-Tenant-Id: db4b7bdc478946e2ad0a2060b433b42c Apr 23 04:05:06 user devstack@n-api.service[61307]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-509507797 Apr 23 04:05:06 user devstack@n-api.service[61307]: X-User: tempest-ServerRescueNegativeTestJSON-509507797-project-member Apr 23 04:05:06 user devstack@n-api.service[61307]: X-User-Domain-Id: default Apr 23 04:05:06 user devstack@n-api.service[61307]: X-User-Domain-Name: Default Apr 23 04:05:06 user devstack@n-api.service[61307]: X-User-Id: 84b2f522c7164c5c934b8bbf113b542a Apr 23 04:05:06 user devstack@n-api.service[61307]: X-User-Name: tempest-ServerRescueNegativeTestJSON-509507797-project-member Apr 23 04:05:06 user devstack@n-api.service[61307]: method: > Apr 23 04:05:06 user devstack@n-api.service[61307]: exception: Instance 27abe5af-8845-40e6-a9c3-12399369b117 could not be found. Apr 23 04:05:06 user devstack@n-api.service[61307]: action_args: {'id': '27abe5af-8845-40e6-a9c3-12399369b117'} Apr 23 04:05:06 user devstack@n-api.service[61307]: {{(pid=61307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 23 04:05:06 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 23 04:05:06 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 23 04:05:06 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 23 04:05:06 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 23 04:05:06 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 23 04:05:06 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 23 04:05:06 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 23 04:05:06 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 23 04:05:06 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 23 04:05:06 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27abe5af-8845-40e6-a9c3-12399369b117 could not be found. Apr 23 04:05:06 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi Apr 23 04:05:06 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 23 04:05:06 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi Apr 23 04:05:06 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 23 04:05:06 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 23 04:05:06 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 23 04:05:06 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 23 04:05:06 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 23 04:05:06 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 23 04:05:06 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 23 04:05:06 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 23 04:05:06 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 23 04:05:06 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 23 04:05:06 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 23 04:05:06 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 23 04:05:06 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 23 04:05:06 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27abe5af-8845-40e6-a9c3-12399369b117 could not be found. Apr 23 04:05:06 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi Apr 23 04:05:06 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 23 04:05:06 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi Apr 23 04:05:06 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 23 04:05:06 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 23 04:05:06 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 23 04:05:06 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 23 04:05:06 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 23 04:05:06 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27abe5af-8845-40e6-a9c3-12399369b117 could not be found. Apr 23 04:05:06 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi Apr 23 04:05:06 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi [None req-663c37d0-3e68-4a47-8a3b-34098dcaa5a6 tempest-ServerRescueNegativeTestJSON-509507797 tempest-ServerRescueNegativeTestJSON-509507797-project-member] Returning 404 to user: Instance 27abe5af-8845-40e6-a9c3-12399369b117 could not be found. {{(pid=61307) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 23 04:05:06 user devstack@n-api.service[61307]: INFO nova.api.openstack.requestlog [None req-663c37d0-3e68-4a47-8a3b-34098dcaa5a6 tempest-ServerRescueNegativeTestJSON-509507797 tempest-ServerRescueNegativeTestJSON-509507797-project-member] 10.0.0.210 "GET /compute/v2.1/servers/27abe5af-8845-40e6-a9c3-12399369b117" status: 404 len: 111 microversion: 2.1 time: 0.028487 Apr 23 04:05:06 user devstack@n-api.service[61307]: [pid: 61307|app: 0|req: 136/407] 10.0.0.210 () {62 vars in 1313 bytes} [Sun Apr 23 04:05:06 2023] GET /compute/v2.1/servers/27abe5af-8845-40e6-a9c3-12399369b117 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 23 04:05:16 user devstack@n-api.service[61308]: DEBUG dbcounter [-] [61308] Writing DB stats nova_api:SELECT=4 {{(pid=61308) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 04:05:16 user devstack@n-api.service[61308]: DEBUG dbcounter [-] [61308] Writing DB stats nova_cell1:SELECT=8 {{(pid=61308) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 04:05:16 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi [None req-a182a5f6-2c4b-45f4-bc41-bb53acbd6bfc tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] Action: 'create', calling method: .version_select at 0x7f21e10d75b0>, body: {"keypair": {"name": "tempest-keypair-679082328", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBByIgBCVO1TwHgSgzcCgt56xToj40uPOeHYofZEu1bJvNmhrfUCOYMcMRL/mO4ojjhrAB0fmobOyBQIrSmCW/jGTnyXoK8G1fv5rap39s97Qi9SpKbhu+T8NGRCCInZWaw=="}} {{(pid=61308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 04:05:16 user devstack@n-api.service[61308]: DEBUG nova.quota [None req-a182a5f6-2c4b-45f4-bc41-bb53acbd6bfc tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] Getting quotas for project 7d84d2e6776c4ac38b90b752a36600c3. Resources: {'key_pairs'} {{(pid=61308) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 23 04:05:16 user devstack@n-api.service[61308]: DEBUG nova.quota [None req-a182a5f6-2c4b-45f4-bc41-bb53acbd6bfc tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] Getting quotas for user 929f88dec4234641a37fdda799108cf2 and project 7d84d2e6776c4ac38b90b752a36600c3. Resources: {'key_pairs'} {{(pid=61308) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 23 04:05:16 user devstack@n-api.service[61308]: INFO nova.api.openstack.requestlog [None req-a182a5f6-2c4b-45f4-bc41-bb53acbd6bfc tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.154403 Apr 23 04:05:16 user devstack@n-api.service[61308]: [pid: 61308|app: 0|req: 138/408] 10.0.0.210 () {66 vars in 1277 bytes} [Sun Apr 23 04:05:16 2023] POST /compute/v2.1/os-keypairs => generated 400 bytes in 156 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 23 04:05:17 user devstack@n-api.service[61306]: DEBUG dbcounter [-] [61306] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61306) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 04:05:17 user devstack@n-api.service[61306]: DEBUG dbcounter [-] [61306] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61306) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 04:05:17 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi [None req-3cd718e2-feaf-490d-b950-ce564388c25a tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1244076250", "imageRef": "e6127373-9931-4277-9458-eceef653ea1e", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "cf3a95ac-e77f-4ee9-ba56-283fc32b7f8b"}], "security_groups": [{"name": "tempest-securitygroup--2051476936"}], "key_name": "tempest-keypair-679082328", "user_data": "}} {{(pid=61306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 04:05:17 user devstack@n-api.service[61306]: DEBUG nova.network.neutron [None req-3cd718e2-feaf-490d-b950-ce564388c25a tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] validate_networks() for [('cf3a95ac-e77f-4ee9-ba56-283fc32b7f8b', None, None, None, None, None)] {{(pid=61306) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 23 04:05:18 user devstack@n-api.service[61306]: DEBUG nova.virt.hardware [None req-3cd718e2-feaf-490d-b950-ce564388c25a tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] Flavor limits 0:0:0 {{(pid=61306) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 23 04:05:18 user devstack@n-api.service[61306]: DEBUG nova.virt.hardware [None req-3cd718e2-feaf-490d-b950-ce564388c25a tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] Image limits 0:0:0 {{(pid=61306) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 23 04:05:18 user devstack@n-api.service[61306]: DEBUG nova.virt.hardware [None req-3cd718e2-feaf-490d-b950-ce564388c25a tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] Flavor pref 0:0:0 {{(pid=61306) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 23 04:05:18 user devstack@n-api.service[61306]: DEBUG nova.virt.hardware [None req-3cd718e2-feaf-490d-b950-ce564388c25a tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] Image pref 0:0:0 {{(pid=61306) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 23 04:05:18 user devstack@n-api.service[61306]: DEBUG nova.virt.hardware [None req-3cd718e2-feaf-490d-b950-ce564388c25a tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61306) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 23 04:05:18 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-3cd718e2-feaf-490d-b950-ce564388c25a tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 04:05:18 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-3cd718e2-feaf-490d-b950-ce564388c25a tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 04:05:18 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-3cd718e2-feaf-490d-b950-ce564388c25a tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 04:05:18 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-3cd718e2-feaf-490d-b950-ce564388c25a tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 04:05:18 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-3cd718e2-feaf-490d-b950-ce564388c25a tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 04:05:18 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-3cd718e2-feaf-490d-b950-ce564388c25a tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 04:05:18 user devstack@n-api.service[61306]: DEBUG nova.quota [None req-3cd718e2-feaf-490d-b950-ce564388c25a tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] Getting quotas for project 7d84d2e6776c4ac38b90b752a36600c3. Resources: {'ram', 'instances', 'cores'} {{(pid=61306) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 23 04:05:18 user devstack@n-api.service[61306]: DEBUG nova.quota [None req-3cd718e2-feaf-490d-b950-ce564388c25a tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] Getting quotas for user 929f88dec4234641a37fdda799108cf2 and project 7d84d2e6776c4ac38b90b752a36600c3. Resources: {'ram', 'instances', 'cores'} {{(pid=61306) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 23 04:05:18 user devstack@n-api.service[61306]: DEBUG nova.compute.api [None req-3cd718e2-feaf-490d-b950-ce564388c25a tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] Going to run 1 instances... {{(pid=61306) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 23 04:05:18 user devstack@n-api.service[61306]: DEBUG nova.compute.api [None req-3cd718e2-feaf-490d-b950-ce564388c25a tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] [instance: 4205fb36-0df5-4c11-b468-89f59d97352c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e6127373-9931-4277-9458-eceef653ea1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61306) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 23 04:05:18 user devstack@n-api.service[61306]: INFO nova.api.openstack.requestlog [None req-3cd718e2-feaf-490d-b950-ce564388c25a tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.20 time: 0.882053 Apr 23 04:05:18 user devstack@n-api.service[61306]: [pid: 61306|app: 0|req: 135/409] 10.0.0.210 () {66 vars in 1265 bytes} [Sun Apr 23 04:05:17 2023] POST /compute/v2.1/servers => generated 400 bytes in 884 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 23 04:05:18 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi [None req-16b18f96-7f4c-4b2f-817f-76f90d4ab1f4 tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] Calling method '>' {{(pid=61307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 04:05:18 user devstack@n-api.service[61307]: DEBUG nova.compute.api [None req-16b18f96-7f4c-4b2f-817f-76f90d4ab1f4 tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] [instance: 4205fb36-0df5-4c11-b468-89f59d97352c] Fetching instance by UUID {{(pid=61307) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 23 04:05:18 user devstack@n-api.service[61307]: DEBUG dbcounter [-] [61307] Writing DB stats nova_api:SELECT=6 {{(pid=61307) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 04:05:18 user devstack@n-api.service[61307]: DEBUG dbcounter [-] [61307] Writing DB stats nova_cell1:SELECT=6 {{(pid=61307) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 04:05:18 user devstack@n-api.service[61307]: DEBUG nova.policy [None req-16b18f96-7f4c-4b2f-817f-76f90d4ab1f4 tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929f88dec4234641a37fdda799108cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d84d2e6776c4ac38b90b752a36600c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61307) authorize /opt/stack/nova/nova/policy.py:203}} Apr 23 04:05:18 user devstack@n-api.service[61307]: DEBUG nova.policy [None req-16b18f96-7f4c-4b2f-817f-76f90d4ab1f4 tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '929f88dec4234641a37fdda799108cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d84d2e6776c4ac38b90b752a36600c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61307) authorize /opt/stack/nova/nova/policy.py:203}} Apr 23 04:05:18 user devstack@n-api.service[61307]: DEBUG nova.policy [None req-16b18f96-7f4c-4b2f-817f-76f90d4ab1f4 tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '929f88dec4234641a37fdda799108cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d84d2e6776c4ac38b90b752a36600c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61307) authorize /opt/stack/nova/nova/policy.py:203}} Apr 23 04:05:18 user devstack@n-api.service[61307]: INFO nova.api.openstack.requestlog [None req-16b18f96-7f4c-4b2f-817f-76f90d4ab1f4 tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4205fb36-0df5-4c11-b468-89f59d97352c" status: 200 len: 1275 microversion: 2.20 time: 0.078003 Apr 23 04:05:18 user devstack@n-api.service[61307]: [pid: 61307|app: 0|req: 137/410] 10.0.0.210 () {64 vars in 1354 bytes} [Sun Apr 23 04:05:18 2023] GET /compute/v2.1/servers/4205fb36-0df5-4c11-b468-89f59d97352c => generated 1275 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 23 04:05:20 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi [req-385cc9c5-cbbe-4aa0-b171-86daa36f002b req-c97ab7c9-7d66-42e7-84fc-004809cf1622 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4205fb36-0df5-4c11-b468-89f59d97352c", "tag": "bb5db91e-75d7-4a5c-90c4-66035e0f7628"}]} {{(pid=61308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 04:05:20 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [req-385cc9c5-cbbe-4aa0-b171-86daa36f002b req-c97ab7c9-7d66-42e7-84fc-004809cf1622 service nova] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 04:05:20 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [req-385cc9c5-cbbe-4aa0-b171-86daa36f002b req-c97ab7c9-7d66-42e7-84fc-004809cf1622 service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 04:05:20 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [req-385cc9c5-cbbe-4aa0-b171-86daa36f002b req-c97ab7c9-7d66-42e7-84fc-004809cf1622 service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 04:05:20 user devstack@n-api.service[61308]: INFO nova.api.openstack.compute.server_external_events [req-385cc9c5-cbbe-4aa0-b171-86daa36f002b req-c97ab7c9-7d66-42e7-84fc-004809cf1622 service nova] Creating event network-changed:bb5db91e-75d7-4a5c-90c4-66035e0f7628 for instance 4205fb36-0df5-4c11-b468-89f59d97352c on user Apr 23 04:05:20 user devstack@n-api.service[61308]: INFO nova.api.openstack.requestlog [req-385cc9c5-cbbe-4aa0-b171-86daa36f002b req-c97ab7c9-7d66-42e7-84fc-004809cf1622 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031036 Apr 23 04:05:20 user devstack@n-api.service[61308]: [pid: 61308|app: 0|req: 139/411] 10.0.0.210 () {68 vars in 1394 bytes} [Sun Apr 23 04:05:20 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 23 04:05:22 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi [req-1816177f-9d84-407b-abd1-57c337b93f17 req-e84002a7-2ab0-4b70-b5e0-7a8fd482a6b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4205fb36-0df5-4c11-b468-89f59d97352c", "name": "network-vif-plugged", "status": "completed", "tag": "bb5db91e-75d7-4a5c-90c4-66035e0f7628"}]} {{(pid=61306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 04:05:22 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [req-1816177f-9d84-407b-abd1-57c337b93f17 req-e84002a7-2ab0-4b70-b5e0-7a8fd482a6b1 service nova] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 04:05:22 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [req-1816177f-9d84-407b-abd1-57c337b93f17 req-e84002a7-2ab0-4b70-b5e0-7a8fd482a6b1 service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 04:05:22 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [req-1816177f-9d84-407b-abd1-57c337b93f17 req-e84002a7-2ab0-4b70-b5e0-7a8fd482a6b1 service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 04:05:22 user devstack@n-api.service[61306]: INFO nova.api.openstack.compute.server_external_events [req-1816177f-9d84-407b-abd1-57c337b93f17 req-e84002a7-2ab0-4b70-b5e0-7a8fd482a6b1 service nova] Creating event network-vif-plugged:bb5db91e-75d7-4a5c-90c4-66035e0f7628 for instance 4205fb36-0df5-4c11-b468-89f59d97352c on user Apr 23 04:05:22 user devstack@n-api.service[61306]: INFO nova.api.openstack.requestlog [req-1816177f-9d84-407b-abd1-57c337b93f17 req-e84002a7-2ab0-4b70-b5e0-7a8fd482a6b1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095516 Apr 23 04:05:22 user devstack@n-api.service[61306]: [pid: 61306|app: 0|req: 136/412] 10.0.0.210 () {68 vars in 1394 bytes} [Sun Apr 23 04:05:22 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 23 04:05:24 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi [req-8d103cd0-3f5d-43e0-8e7d-4acfedbd5817 req-7d131158-9368-42ac-8806-1193a5d86fa1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4205fb36-0df5-4c11-b468-89f59d97352c", "name": "network-vif-plugged", "status": "completed", "tag": "bb5db91e-75d7-4a5c-90c4-66035e0f7628"}]} {{(pid=61307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 04:05:24 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [req-8d103cd0-3f5d-43e0-8e7d-4acfedbd5817 req-7d131158-9368-42ac-8806-1193a5d86fa1 service nova] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 04:05:24 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [req-8d103cd0-3f5d-43e0-8e7d-4acfedbd5817 req-7d131158-9368-42ac-8806-1193a5d86fa1 service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 04:05:24 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [req-8d103cd0-3f5d-43e0-8e7d-4acfedbd5817 req-7d131158-9368-42ac-8806-1193a5d86fa1 service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 04:05:24 user devstack@n-api.service[61307]: INFO nova.api.openstack.compute.server_external_events [req-8d103cd0-3f5d-43e0-8e7d-4acfedbd5817 req-7d131158-9368-42ac-8806-1193a5d86fa1 service nova] Creating event network-vif-plugged:bb5db91e-75d7-4a5c-90c4-66035e0f7628 for instance 4205fb36-0df5-4c11-b468-89f59d97352c on user Apr 23 04:05:24 user devstack@n-api.service[61307]: INFO nova.api.openstack.requestlog [req-8d103cd0-3f5d-43e0-8e7d-4acfedbd5817 req-7d131158-9368-42ac-8806-1193a5d86fa1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029072 Apr 23 04:05:24 user devstack@n-api.service[61307]: [pid: 61307|app: 0|req: 138/413] 10.0.0.210 () {68 vars in 1394 bytes} [Sun Apr 23 04:05:24 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 23 04:05:48 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi [None req-b8a7fbf8-53a6-4c89-a73a-2a5a3beb8451 tempest-ServersNegativeTestJSON-1115615559 tempest-ServersNegativeTestJSON-1115615559-project-member] Calling method '>' {{(pid=61308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 04:05:48 user devstack@n-api.service[61308]: DEBUG nova.compute.api [None req-b8a7fbf8-53a6-4c89-a73a-2a5a3beb8451 tempest-ServersNegativeTestJSON-1115615559 tempest-ServersNegativeTestJSON-1115615559-project-member] [instance: ee89a9d5-0507-475c-bea2-e02e34d15710] Fetching instance by UUID {{(pid=61308) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 23 04:05:48 user devstack@n-api.service[61308]: DEBUG dbcounter [-] [61308] Writing DB stats nova_cell0:SELECT=4 {{(pid=61308) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 04:05:48 user devstack@n-api.service[61308]: DEBUG dbcounter [-] [61308] Writing DB stats nova_api:SELECT=13,nova_api:INSERT=1 {{(pid=61308) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 04:05:48 user devstack@n-api.service[61308]: DEBUG dbcounter [-] [61308] Writing DB stats nova_cell1:SELECT=2 {{(pid=61308) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 04:05:48 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-b8a7fbf8-53a6-4c89-a73a-2a5a3beb8451 tempest-ServersNegativeTestJSON-1115615559 tempest-ServersNegativeTestJSON-1115615559-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 04:05:48 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-b8a7fbf8-53a6-4c89-a73a-2a5a3beb8451 tempest-ServersNegativeTestJSON-1115615559 tempest-ServersNegativeTestJSON-1115615559-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 04:05:48 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-b8a7fbf8-53a6-4c89-a73a-2a5a3beb8451 tempest-ServersNegativeTestJSON-1115615559 tempest-ServersNegativeTestJSON-1115615559-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 04:05:48 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-b8a7fbf8-53a6-4c89-a73a-2a5a3beb8451 tempest-ServersNegativeTestJSON-1115615559 tempest-ServersNegativeTestJSON-1115615559-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 04:05:48 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-b8a7fbf8-53a6-4c89-a73a-2a5a3beb8451 tempest-ServersNegativeTestJSON-1115615559 tempest-ServersNegativeTestJSON-1115615559-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 04:05:48 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-b8a7fbf8-53a6-4c89-a73a-2a5a3beb8451 tempest-ServersNegativeTestJSON-1115615559 tempest-ServersNegativeTestJSON-1115615559-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 04:05:48 user devstack@n-api.service[61308]: INFO nova.api.openstack.wsgi [None req-b8a7fbf8-53a6-4c89-a73a-2a5a3beb8451 tempest-ServersNegativeTestJSON-1115615559 tempest-ServersNegativeTestJSON-1115615559-project-member] HTTP exception thrown: Instance ee89a9d5-0507-475c-bea2-e02e34d15710 could not be found. Apr 23 04:05:48 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi [None req-b8a7fbf8-53a6-4c89-a73a-2a5a3beb8451 tempest-ServersNegativeTestJSON-1115615559 tempest-ServersNegativeTestJSON-1115615559-project-member] Request method failure captured: Apr 23 04:05:48 user devstack@n-api.service[61308]: request: GET /compute/v2.1/servers/ee89a9d5-0507-475c-bea2-e02e34d15710 HTTP/1.1 Apr 23 04:05:48 user devstack@n-api.service[61308]: Accept: application/json Apr 23 04:05:48 user devstack@n-api.service[61308]: Accept-Encoding: identity Apr 23 04:05:48 user devstack@n-api.service[61308]: Connection: close Apr 23 04:05:48 user devstack@n-api.service[61308]: Content-Length: 0 Apr 23 04:05:48 user devstack@n-api.service[61308]: Content-Type: application/json Apr 23 04:05:48 user devstack@n-api.service[61308]: Host: 10.0.0.210 Apr 23 04:05:48 user devstack@n-api.service[61308]: Openstack-System-Scope: None Apr 23 04:05:48 user devstack@n-api.service[61308]: User-Agent: python-urllib3/1.26.15 Apr 23 04:05:48 user devstack@n-api.service[61308]: X-Auth-Token: gAAAAABkRKxjEhCjoNMqtLhu2RxdK5iis_mOy1m1OhYgEHq1hqZgaDN8nyVa42IgLK3MeaWhPhYnxfP3I5ZsEj0up2VGTAfJAsexVojvTvodGrsXaEkQKlVj5_rGG_Fhan4XJMitnwDyPDaY7kHeCRdEkSPEhUCq-5gRNlv5HuvOmo51IwGtFWM Apr 23 04:05:48 user devstack@n-api.service[61308]: X-Domain-Id: None Apr 23 04:05:48 user devstack@n-api.service[61308]: X-Domain-Name: None Apr 23 04:05:48 user devstack@n-api.service[61308]: X-Identity-Status: Confirmed Apr 23 04:05:48 user devstack@n-api.service[61308]: X-Is-Admin-Project: True Apr 23 04:05:48 user devstack@n-api.service[61308]: X-Project-Domain-Id: default Apr 23 04:05:48 user devstack@n-api.service[61308]: X-Project-Domain-Name: Default Apr 23 04:05:48 user devstack@n-api.service[61308]: X-Project-Id: 39d6cb4cfcb2413f8039ee9febf1c046 Apr 23 04:05:48 user devstack@n-api.service[61308]: X-Project-Name: tempest-ServersNegativeTestJSON-1115615559 Apr 23 04:05:48 user devstack@n-api.service[61308]: X-Role: reader,member Apr 23 04:05:48 user devstack@n-api.service[61308]: X-Roles: reader,member Apr 23 04:05:48 user devstack@n-api.service[61308]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/39d6cb4cfcb2413f8039ee9febf1c046"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/39d6cb4cfcb2413f8039ee9febf1c046"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/39d6cb4cfcb2413f8039ee9febf1c046"}]}] Apr 23 04:05:48 user devstack@n-api.service[61308]: X-Tenant: tempest-ServersNegativeTestJSON-1115615559 Apr 23 04:05:48 user devstack@n-api.service[61308]: X-Tenant-Id: 39d6cb4cfcb2413f8039ee9febf1c046 Apr 23 04:05:48 user devstack@n-api.service[61308]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1115615559 Apr 23 04:05:48 user devstack@n-api.service[61308]: X-User: tempest-ServersNegativeTestJSON-1115615559-project-member Apr 23 04:05:48 user devstack@n-api.service[61308]: X-User-Domain-Id: default Apr 23 04:05:48 user devstack@n-api.service[61308]: X-User-Domain-Name: Default Apr 23 04:05:48 user devstack@n-api.service[61308]: X-User-Id: 45d9ae4a3b00492fa2fc16a22a34df09 Apr 23 04:05:48 user devstack@n-api.service[61308]: X-User-Name: tempest-ServersNegativeTestJSON-1115615559-project-member Apr 23 04:05:48 user devstack@n-api.service[61308]: method: > Apr 23 04:05:48 user devstack@n-api.service[61308]: exception: Instance ee89a9d5-0507-475c-bea2-e02e34d15710 could not be found. Apr 23 04:05:48 user devstack@n-api.service[61308]: action_args: {'id': 'ee89a9d5-0507-475c-bea2-e02e34d15710'} Apr 23 04:05:48 user devstack@n-api.service[61308]: {{(pid=61308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 23 04:05:48 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 23 04:05:48 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 23 04:05:48 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 23 04:05:48 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 23 04:05:48 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 23 04:05:48 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 23 04:05:48 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 23 04:05:48 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 23 04:05:48 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 23 04:05:48 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee89a9d5-0507-475c-bea2-e02e34d15710 could not be found. Apr 23 04:05:48 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi Apr 23 04:05:48 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 23 04:05:48 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi Apr 23 04:05:48 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 23 04:05:48 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 23 04:05:48 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 23 04:05:48 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 23 04:05:48 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 23 04:05:48 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 23 04:05:48 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 23 04:05:48 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 23 04:05:48 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 23 04:05:48 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 23 04:05:48 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 23 04:05:48 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 23 04:05:48 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 23 04:05:48 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee89a9d5-0507-475c-bea2-e02e34d15710 could not be found. Apr 23 04:05:48 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi Apr 23 04:05:48 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 23 04:05:48 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi Apr 23 04:05:48 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 23 04:05:48 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 23 04:05:48 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 23 04:05:48 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 23 04:05:48 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 23 04:05:48 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee89a9d5-0507-475c-bea2-e02e34d15710 could not be found. Apr 23 04:05:48 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi Apr 23 04:05:48 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi [None req-b8a7fbf8-53a6-4c89-a73a-2a5a3beb8451 tempest-ServersNegativeTestJSON-1115615559 tempest-ServersNegativeTestJSON-1115615559-project-member] Returning 404 to user: Instance ee89a9d5-0507-475c-bea2-e02e34d15710 could not be found. {{(pid=61308) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 23 04:05:48 user devstack@n-api.service[61308]: INFO nova.api.openstack.requestlog [None req-b8a7fbf8-53a6-4c89-a73a-2a5a3beb8451 tempest-ServersNegativeTestJSON-1115615559 tempest-ServersNegativeTestJSON-1115615559-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ee89a9d5-0507-475c-bea2-e02e34d15710" status: 404 len: 111 microversion: 2.1 time: 0.038576 Apr 23 04:05:48 user devstack@n-api.service[61308]: [pid: 61308|app: 0|req: 140/414] 10.0.0.210 () {62 vars in 1313 bytes} [Sun Apr 23 04:05:48 2023] GET /compute/v2.1/servers/ee89a9d5-0507-475c-bea2-e02e34d15710 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 23 04:06:08 user devstack@n-api.service[61306]: DEBUG dbcounter [-] [61306] Writing DB stats nova_cell0:SELECT=2 {{(pid=61306) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 04:06:08 user devstack@n-api.service[61306]: DEBUG dbcounter [-] [61306] Writing DB stats nova_cell0:SELECT=6 {{(pid=61306) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 04:06:08 user devstack@n-api.service[61306]: DEBUG dbcounter [-] [61306] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=3 {{(pid=61306) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 04:06:08 user devstack@n-api.service[61306]: DEBUG dbcounter [-] [61306] Writing DB stats nova_cell1:SELECT=4 {{(pid=61306) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 04:06:08 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi [None req-4938d0ed-715d-476b-ad92-3b44da72602c tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] Calling method '>' {{(pid=61306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 04:06:08 user devstack@n-api.service[61306]: DEBUG nova.compute.api [None req-4938d0ed-715d-476b-ad92-3b44da72602c tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] [instance: 4205fb36-0df5-4c11-b468-89f59d97352c] Fetching instance by UUID {{(pid=61306) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 23 04:06:08 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-4938d0ed-715d-476b-ad92-3b44da72602c tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 04:06:08 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-4938d0ed-715d-476b-ad92-3b44da72602c tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 04:06:08 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-4938d0ed-715d-476b-ad92-3b44da72602c tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 04:06:08 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-4938d0ed-715d-476b-ad92-3b44da72602c tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 04:06:08 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-4938d0ed-715d-476b-ad92-3b44da72602c tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 04:06:08 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-4938d0ed-715d-476b-ad92-3b44da72602c tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 04:06:08 user devstack@n-api.service[61306]: DEBUG nova.policy [None req-4938d0ed-715d-476b-ad92-3b44da72602c tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929f88dec4234641a37fdda799108cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d84d2e6776c4ac38b90b752a36600c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61306) authorize /opt/stack/nova/nova/policy.py:203}} Apr 23 04:06:08 user devstack@n-api.service[61306]: DEBUG nova.policy [None req-4938d0ed-715d-476b-ad92-3b44da72602c tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '929f88dec4234641a37fdda799108cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d84d2e6776c4ac38b90b752a36600c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61306) authorize /opt/stack/nova/nova/policy.py:203}} Apr 23 04:06:08 user devstack@n-api.service[61306]: DEBUG nova.policy [None req-4938d0ed-715d-476b-ad92-3b44da72602c tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '929f88dec4234641a37fdda799108cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d84d2e6776c4ac38b90b752a36600c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61306) authorize /opt/stack/nova/nova/policy.py:203}} Apr 23 04:06:08 user devstack@n-api.service[61306]: INFO nova.api.openstack.requestlog [None req-4938d0ed-715d-476b-ad92-3b44da72602c tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4205fb36-0df5-4c11-b468-89f59d97352c" status: 200 len: 1588 microversion: 2.20 time: 0.258335 Apr 23 04:06:08 user devstack@n-api.service[61306]: [pid: 61306|app: 0|req: 137/415] 10.0.0.210 () {64 vars in 1354 bytes} [Sun Apr 23 04:06:08 2023] GET /compute/v2.1/servers/4205fb36-0df5-4c11-b468-89f59d97352c => generated 1588 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 23 04:06:19 user devstack@n-api.service[61307]: DEBUG dbcounter [-] [61307] Writing DB stats nova_cell0:SELECT=2 {{(pid=61307) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 04:06:19 user devstack@n-api.service[61307]: DEBUG dbcounter [-] [61307] Writing DB stats nova_api:SELECT=6 {{(pid=61307) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 04:06:19 user devstack@n-api.service[61307]: DEBUG dbcounter [-] [61307] Writing DB stats nova_cell1:SELECT=2 {{(pid=61307) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 04:06:19 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi [None req-77411514-1a78-46fe-969a-a8827c21b371 tempest-SnapshotDataIntegrityTests-64123451 tempest-SnapshotDataIntegrityTests-64123451-project-member] Action: 'create', calling method: .version_select at 0x7f21e10cd1b0>, body: {"keypair": {"name": "tempest-SnapshotDataIntegrityTests-739066652", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAu60RPBRY8ixX0DVPXyTC0obHZtMSQn+/eQe4CX41J6ZGl9/35/LZ6Mg27oUkmRdsopV1StlsbxkgFLQHMAYMn979AL7gketvktWqIxDsED8DUOxN69qCEepNW76Mz/YA=="}} {{(pid=61307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 04:06:19 user devstack@n-api.service[61307]: DEBUG nova.quota [None req-77411514-1a78-46fe-969a-a8827c21b371 tempest-SnapshotDataIntegrityTests-64123451 tempest-SnapshotDataIntegrityTests-64123451-project-member] Getting quotas for project f7eb2f69eab54dd8aac3e6cca9d5e46a. Resources: {'key_pairs'} {{(pid=61307) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 23 04:06:19 user devstack@n-api.service[61307]: DEBUG nova.quota [None req-77411514-1a78-46fe-969a-a8827c21b371 tempest-SnapshotDataIntegrityTests-64123451 tempest-SnapshotDataIntegrityTests-64123451-project-member] Getting quotas for user c452706dd7dc4f54b45e9f959288bd6b and project f7eb2f69eab54dd8aac3e6cca9d5e46a. Resources: {'key_pairs'} {{(pid=61307) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 23 04:06:19 user devstack@n-api.service[61307]: INFO nova.api.openstack.requestlog [None req-77411514-1a78-46fe-969a-a8827c21b371 tempest-SnapshotDataIntegrityTests-64123451 tempest-SnapshotDataIntegrityTests-64123451-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.344946 Apr 23 04:06:19 user devstack@n-api.service[61307]: [pid: 61307|app: 0|req: 139/416] 10.0.0.210 () {64 vars in 1236 bytes} [Sun Apr 23 04:06:19 2023] POST /compute/v2.1/os-keypairs => generated 404 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 23 04:06:21 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi [None req-422dd174-07ea-4231-b040-6a90648552e6 tempest-SnapshotDataIntegrityTests-64123451 tempest-SnapshotDataIntegrityTests-64123451-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SnapshotDataIntegrityTests-server-1589353047", "imageRef": "e6127373-9931-4277-9458-eceef653ea1e", "flavorRef": "42", "key_name": "tempest-SnapshotDataIntegrityTests-739066652", "security_groups": [{"name": "tempest-secgroup-smoke-1023942609"}], "networks": [{"uuid": "82debf07-b0f5-4ec4-95e8-bd8a03b0cdb9"}]}} {{(pid=61308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 04:06:21 user devstack@n-api.service[61308]: DEBUG dbcounter [-] [61308] Writing DB stats nova_cell1:SELECT=2 {{(pid=61308) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 04:06:21 user devstack@n-api.service[61308]: DEBUG dbcounter [-] [61308] Writing DB stats nova_api:SELECT=2 {{(pid=61308) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 04:06:21 user devstack@n-api.service[61308]: DEBUG nova.network.neutron [None req-422dd174-07ea-4231-b040-6a90648552e6 tempest-SnapshotDataIntegrityTests-64123451 tempest-SnapshotDataIntegrityTests-64123451-project-member] validate_networks() for [('82debf07-b0f5-4ec4-95e8-bd8a03b0cdb9', None, None, None, None, None)] {{(pid=61308) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 23 04:06:22 user devstack@n-api.service[61308]: DEBUG nova.virt.hardware [None req-422dd174-07ea-4231-b040-6a90648552e6 tempest-SnapshotDataIntegrityTests-64123451 tempest-SnapshotDataIntegrityTests-64123451-project-member] Flavor limits 0:0:0 {{(pid=61308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 23 04:06:22 user devstack@n-api.service[61308]: DEBUG nova.virt.hardware [None req-422dd174-07ea-4231-b040-6a90648552e6 tempest-SnapshotDataIntegrityTests-64123451 tempest-SnapshotDataIntegrityTests-64123451-project-member] Image limits 0:0:0 {{(pid=61308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 23 04:06:22 user devstack@n-api.service[61308]: DEBUG nova.virt.hardware [None req-422dd174-07ea-4231-b040-6a90648552e6 tempest-SnapshotDataIntegrityTests-64123451 tempest-SnapshotDataIntegrityTests-64123451-project-member] Flavor pref 0:0:0 {{(pid=61308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 23 04:06:22 user devstack@n-api.service[61308]: DEBUG nova.virt.hardware [None req-422dd174-07ea-4231-b040-6a90648552e6 tempest-SnapshotDataIntegrityTests-64123451 tempest-SnapshotDataIntegrityTests-64123451-project-member] Image pref 0:0:0 {{(pid=61308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 23 04:06:22 user devstack@n-api.service[61308]: DEBUG nova.virt.hardware [None req-422dd174-07ea-4231-b040-6a90648552e6 tempest-SnapshotDataIntegrityTests-64123451 tempest-SnapshotDataIntegrityTests-64123451-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 23 04:06:22 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-422dd174-07ea-4231-b040-6a90648552e6 tempest-SnapshotDataIntegrityTests-64123451 tempest-SnapshotDataIntegrityTests-64123451-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 04:06:22 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-422dd174-07ea-4231-b040-6a90648552e6 tempest-SnapshotDataIntegrityTests-64123451 tempest-SnapshotDataIntegrityTests-64123451-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 04:06:22 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-422dd174-07ea-4231-b040-6a90648552e6 tempest-SnapshotDataIntegrityTests-64123451 tempest-SnapshotDataIntegrityTests-64123451-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 04:06:22 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-422dd174-07ea-4231-b040-6a90648552e6 tempest-SnapshotDataIntegrityTests-64123451 tempest-SnapshotDataIntegrityTests-64123451-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 04:06:22 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-422dd174-07ea-4231-b040-6a90648552e6 tempest-SnapshotDataIntegrityTests-64123451 tempest-SnapshotDataIntegrityTests-64123451-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 04:06:22 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-422dd174-07ea-4231-b040-6a90648552e6 tempest-SnapshotDataIntegrityTests-64123451 tempest-SnapshotDataIntegrityTests-64123451-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 04:06:22 user devstack@n-api.service[61308]: DEBUG nova.quota [None req-422dd174-07ea-4231-b040-6a90648552e6 tempest-SnapshotDataIntegrityTests-64123451 tempest-SnapshotDataIntegrityTests-64123451-project-member] Getting quotas for project f7eb2f69eab54dd8aac3e6cca9d5e46a. Resources: {'ram', 'instances', 'cores'} {{(pid=61308) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 23 04:06:22 user devstack@n-api.service[61308]: DEBUG nova.quota [None req-422dd174-07ea-4231-b040-6a90648552e6 tempest-SnapshotDataIntegrityTests-64123451 tempest-SnapshotDataIntegrityTests-64123451-project-member] Getting quotas for user c452706dd7dc4f54b45e9f959288bd6b and project f7eb2f69eab54dd8aac3e6cca9d5e46a. Resources: {'ram', 'instances', 'cores'} {{(pid=61308) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 23 04:06:22 user devstack@n-api.service[61308]: DEBUG nova.compute.api [None req-422dd174-07ea-4231-b040-6a90648552e6 tempest-SnapshotDataIntegrityTests-64123451 tempest-SnapshotDataIntegrityTests-64123451-project-member] Going to run 1 instances... {{(pid=61308) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 23 04:06:22 user devstack@n-api.service[61308]: DEBUG nova.compute.api [None req-422dd174-07ea-4231-b040-6a90648552e6 tempest-SnapshotDataIntegrityTests-64123451 tempest-SnapshotDataIntegrityTests-64123451-project-member] [instance: 8171e321-666d-44fc-a0ef-b297ec22369b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e6127373-9931-4277-9458-eceef653ea1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61308) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 23 04:06:22 user devstack@n-api.service[61308]: INFO nova.api.openstack.requestlog [None req-422dd174-07ea-4231-b040-6a90648552e6 tempest-SnapshotDataIntegrityTests-64123451 tempest-SnapshotDataIntegrityTests-64123451-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.743451 Apr 23 04:06:22 user devstack@n-api.service[61308]: [pid: 61308|app: 0|req: 141/417] 10.0.0.210 () {64 vars in 1224 bytes} [Sun Apr 23 04:06:21 2023] POST /compute/v2.1/servers => generated 404 bytes in 745 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 23 04:06:22 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi [None req-c5e733e0-4f47-4d9c-9846-0cd8e15ed4a5 tempest-SnapshotDataIntegrityTests-64123451 tempest-SnapshotDataIntegrityTests-64123451-project-member] Calling method '>' {{(pid=61306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 04:06:22 user devstack@n-api.service[61306]: DEBUG nova.compute.api [None req-c5e733e0-4f47-4d9c-9846-0cd8e15ed4a5 tempest-SnapshotDataIntegrityTests-64123451 tempest-SnapshotDataIntegrityTests-64123451-project-member] [instance: 8171e321-666d-44fc-a0ef-b297ec22369b] Fetching instance by UUID {{(pid=61306) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 23 04:06:22 user devstack@n-api.service[61306]: DEBUG dbcounter [-] [61306] Writing DB stats nova_api:SELECT=2 {{(pid=61306) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 04:06:22 user devstack@n-api.service[61306]: DEBUG dbcounter [-] [61306] Writing DB stats nova_cell1:SELECT=6 {{(pid=61306) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 04:06:22 user devstack@n-api.service[61306]: DEBUG nova.policy [None req-c5e733e0-4f47-4d9c-9846-0cd8e15ed4a5 tempest-SnapshotDataIntegrityTests-64123451 tempest-SnapshotDataIntegrityTests-64123451-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c452706dd7dc4f54b45e9f959288bd6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7eb2f69eab54dd8aac3e6cca9d5e46a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61306) authorize /opt/stack/nova/nova/policy.py:203}} Apr 23 04:06:22 user devstack@n-api.service[61306]: INFO nova.api.openstack.requestlog [None req-c5e733e0-4f47-4d9c-9846-0cd8e15ed4a5 tempest-SnapshotDataIntegrityTests-64123451 tempest-SnapshotDataIntegrityTests-64123451-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8171e321-666d-44fc-a0ef-b297ec22369b" status: 200 len: 1256 microversion: 2.1 time: 0.062203 Apr 23 04:06:22 user devstack@n-api.service[61306]: [pid: 61306|app: 0|req: 138/418] 10.0.0.210 () {62 vars in 1313 bytes} [Sun Apr 23 04:06:22 2023] GET /compute/v2.1/servers/8171e321-666d-44fc-a0ef-b297ec22369b => generated 1256 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 23 04:06:24 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi [req-63b57f31-5c4b-40b0-ae2d-4af030b5a182 req-c035796d-0f2c-444a-b71f-2d7edc9fe362 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8171e321-666d-44fc-a0ef-b297ec22369b", "tag": "a1a195c9-37d9-45f8-b8dd-989b54c8f2dd"}]} {{(pid=61307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 04:06:24 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [req-63b57f31-5c4b-40b0-ae2d-4af030b5a182 req-c035796d-0f2c-444a-b71f-2d7edc9fe362 service nova] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 04:06:24 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [req-63b57f31-5c4b-40b0-ae2d-4af030b5a182 req-c035796d-0f2c-444a-b71f-2d7edc9fe362 service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 04:06:24 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [req-63b57f31-5c4b-40b0-ae2d-4af030b5a182 req-c035796d-0f2c-444a-b71f-2d7edc9fe362 service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 04:06:24 user devstack@n-api.service[61307]: INFO nova.api.openstack.compute.server_external_events [req-63b57f31-5c4b-40b0-ae2d-4af030b5a182 req-c035796d-0f2c-444a-b71f-2d7edc9fe362 service nova] Creating event network-changed:a1a195c9-37d9-45f8-b8dd-989b54c8f2dd for instance 8171e321-666d-44fc-a0ef-b297ec22369b on user Apr 23 04:06:24 user devstack@n-api.service[61307]: INFO nova.api.openstack.requestlog [req-63b57f31-5c4b-40b0-ae2d-4af030b5a182 req-c035796d-0f2c-444a-b71f-2d7edc9fe362 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028892 Apr 23 04:06:24 user devstack@n-api.service[61307]: [pid: 61307|app: 0|req: 140/419] 10.0.0.210 () {68 vars in 1394 bytes} [Sun Apr 23 04:06:24 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 23 04:06:26 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi [req-22beb47f-7ee8-476a-bedb-2ed1404771ad req-ea041d0f-f065-4cc2-8081-64ced52a674e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8171e321-666d-44fc-a0ef-b297ec22369b", "name": "network-vif-plugged", "status": "completed", "tag": "a1a195c9-37d9-45f8-b8dd-989b54c8f2dd"}]} {{(pid=61308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 04:06:26 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [req-22beb47f-7ee8-476a-bedb-2ed1404771ad req-ea041d0f-f065-4cc2-8081-64ced52a674e service nova] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 04:06:26 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [req-22beb47f-7ee8-476a-bedb-2ed1404771ad req-ea041d0f-f065-4cc2-8081-64ced52a674e service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 04:06:26 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [req-22beb47f-7ee8-476a-bedb-2ed1404771ad req-ea041d0f-f065-4cc2-8081-64ced52a674e service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 04:06:26 user devstack@n-api.service[61308]: INFO nova.api.openstack.compute.server_external_events [req-22beb47f-7ee8-476a-bedb-2ed1404771ad req-ea041d0f-f065-4cc2-8081-64ced52a674e service nova] Creating event network-vif-plugged:a1a195c9-37d9-45f8-b8dd-989b54c8f2dd for instance 8171e321-666d-44fc-a0ef-b297ec22369b on user Apr 23 04:06:26 user devstack@n-api.service[61308]: INFO nova.api.openstack.requestlog [req-22beb47f-7ee8-476a-bedb-2ed1404771ad req-ea041d0f-f065-4cc2-8081-64ced52a674e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035126 Apr 23 04:06:26 user devstack@n-api.service[61308]: [pid: 61308|app: 0|req: 142/420] 10.0.0.210 () {68 vars in 1394 bytes} [Sun Apr 23 04:06:26 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 23 04:06:28 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi [req-e36f7c45-b457-4ffa-a613-c808c2a54d07 req-2ff195f3-41b0-4f0c-8c6a-206fff931883 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8171e321-666d-44fc-a0ef-b297ec22369b", "name": "network-vif-plugged", "status": "completed", "tag": "a1a195c9-37d9-45f8-b8dd-989b54c8f2dd"}]} {{(pid=61306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 04:06:28 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [req-e36f7c45-b457-4ffa-a613-c808c2a54d07 req-2ff195f3-41b0-4f0c-8c6a-206fff931883 service nova] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 04:06:28 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [req-e36f7c45-b457-4ffa-a613-c808c2a54d07 req-2ff195f3-41b0-4f0c-8c6a-206fff931883 service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 04:06:28 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [req-e36f7c45-b457-4ffa-a613-c808c2a54d07 req-2ff195f3-41b0-4f0c-8c6a-206fff931883 service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 04:06:28 user devstack@n-api.service[61306]: INFO nova.api.openstack.compute.server_external_events [req-e36f7c45-b457-4ffa-a613-c808c2a54d07 req-2ff195f3-41b0-4f0c-8c6a-206fff931883 service nova] Creating event network-vif-plugged:a1a195c9-37d9-45f8-b8dd-989b54c8f2dd for instance 8171e321-666d-44fc-a0ef-b297ec22369b on user Apr 23 04:06:28 user devstack@n-api.service[61306]: INFO nova.api.openstack.requestlog [req-e36f7c45-b457-4ffa-a613-c808c2a54d07 req-2ff195f3-41b0-4f0c-8c6a-206fff931883 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027952 Apr 23 04:06:28 user devstack@n-api.service[61306]: [pid: 61306|app: 0|req: 139/421] 10.0.0.210 () {68 vars in 1394 bytes} [Sun Apr 23 04:06:28 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 23 04:07:08 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi [None req-389ddd53-3c32-474c-ad78-7cbac22c0494 tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] Calling method '>' {{(pid=61307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 04:07:08 user devstack@n-api.service[61307]: DEBUG nova.compute.api [None req-389ddd53-3c32-474c-ad78-7cbac22c0494 tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] [instance: 4205fb36-0df5-4c11-b468-89f59d97352c] Fetching instance by UUID {{(pid=61307) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 23 04:07:08 user devstack@n-api.service[61307]: DEBUG dbcounter [-] [61307] Writing DB stats nova_cell0:SELECT=4 {{(pid=61307) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 04:07:08 user devstack@n-api.service[61307]: DEBUG dbcounter [-] [61307] Writing DB stats nova_api:SELECT=13,nova_api:INSERT=1 {{(pid=61307) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 04:07:08 user devstack@n-api.service[61307]: DEBUG dbcounter [-] [61307] Writing DB stats nova_cell1:SELECT=2 {{(pid=61307) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 04:07:08 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-389ddd53-3c32-474c-ad78-7cbac22c0494 tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 04:07:08 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-389ddd53-3c32-474c-ad78-7cbac22c0494 tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 04:07:08 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-389ddd53-3c32-474c-ad78-7cbac22c0494 tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 04:07:08 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-389ddd53-3c32-474c-ad78-7cbac22c0494 tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 04:07:08 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-389ddd53-3c32-474c-ad78-7cbac22c0494 tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 04:07:08 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-389ddd53-3c32-474c-ad78-7cbac22c0494 tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 04:07:09 user devstack@n-api.service[61307]: INFO nova.api.openstack.requestlog [None req-389ddd53-3c32-474c-ad78-7cbac22c0494 tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4205fb36-0df5-4c11-b468-89f59d97352c/os-interface" status: 200 len: 283 microversion: 2.20 time: 0.168637 Apr 23 04:07:09 user devstack@n-api.service[61307]: [pid: 61307|app: 0|req: 141/422] 10.0.0.210 () {64 vars in 1393 bytes} [Sun Apr 23 04:07:08 2023] GET /compute/v2.1/servers/4205fb36-0df5-4c11-b468-89f59d97352c/os-interface => generated 283 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 23 04:07:09 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi [req-f5746e6a-8314-4287-8a0c-96bafec2b286 req-6bc5c730-8725-4899-aec4-b4a6466401c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4205fb36-0df5-4c11-b468-89f59d97352c", "tag": "bb5db91e-75d7-4a5c-90c4-66035e0f7628"}]} {{(pid=61308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 04:07:09 user devstack@n-api.service[61308]: DEBUG dbcounter [-] [61308] Writing DB stats nova_cell0:SELECT=2 {{(pid=61308) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 04:07:09 user devstack@n-api.service[61308]: DEBUG dbcounter [-] [61308] Writing DB stats nova_cell0:SELECT=6 {{(pid=61308) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 04:07:09 user devstack@n-api.service[61308]: DEBUG dbcounter [-] [61308] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=3 {{(pid=61308) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 04:07:09 user devstack@n-api.service[61308]: DEBUG dbcounter [-] [61308] Writing DB stats nova_cell1:SELECT=4 {{(pid=61308) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 04:07:09 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [req-f5746e6a-8314-4287-8a0c-96bafec2b286 req-6bc5c730-8725-4899-aec4-b4a6466401c9 service nova] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 04:07:09 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [req-f5746e6a-8314-4287-8a0c-96bafec2b286 req-6bc5c730-8725-4899-aec4-b4a6466401c9 service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 04:07:09 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [req-f5746e6a-8314-4287-8a0c-96bafec2b286 req-6bc5c730-8725-4899-aec4-b4a6466401c9 service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 04:07:09 user devstack@n-api.service[61308]: INFO nova.api.openstack.compute.server_external_events [req-f5746e6a-8314-4287-8a0c-96bafec2b286 req-6bc5c730-8725-4899-aec4-b4a6466401c9 service nova] Creating event network-changed:bb5db91e-75d7-4a5c-90c4-66035e0f7628 for instance 4205fb36-0df5-4c11-b468-89f59d97352c on user Apr 23 04:07:09 user devstack@n-api.service[61308]: INFO nova.api.openstack.requestlog [req-f5746e6a-8314-4287-8a0c-96bafec2b286 req-6bc5c730-8725-4899-aec4-b4a6466401c9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040408 Apr 23 04:07:09 user devstack@n-api.service[61308]: [pid: 61308|app: 0|req: 143/423] 10.0.0.210 () {68 vars in 1394 bytes} [Sun Apr 23 04:07:09 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 23 04:07:09 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi [None req-5dfdf553-c7e3-4ad2-bfa9-3c08a3577bad tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] Calling method '>' {{(pid=61306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 04:07:09 user devstack@n-api.service[61306]: DEBUG nova.compute.api [None req-5dfdf553-c7e3-4ad2-bfa9-3c08a3577bad tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] [instance: 4205fb36-0df5-4c11-b468-89f59d97352c] Fetching instance by UUID {{(pid=61306) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 23 04:07:09 user devstack@n-api.service[61306]: DEBUG dbcounter [-] [61306] Writing DB stats nova_cell0:SELECT=2 {{(pid=61306) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 04:07:09 user devstack@n-api.service[61306]: DEBUG dbcounter [-] [61306] Writing DB stats nova_api:SELECT=6 {{(pid=61306) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 04:07:09 user devstack@n-api.service[61306]: DEBUG dbcounter [-] [61306] Writing DB stats nova_cell1:SELECT=2 {{(pid=61306) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 04:07:09 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-5dfdf553-c7e3-4ad2-bfa9-3c08a3577bad tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 04:07:09 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-5dfdf553-c7e3-4ad2-bfa9-3c08a3577bad tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 04:07:09 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-5dfdf553-c7e3-4ad2-bfa9-3c08a3577bad tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 04:07:09 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-5dfdf553-c7e3-4ad2-bfa9-3c08a3577bad tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 04:07:09 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-5dfdf553-c7e3-4ad2-bfa9-3c08a3577bad tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 04:07:09 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-5dfdf553-c7e3-4ad2-bfa9-3c08a3577bad tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 04:07:09 user devstack@n-api.service[61306]: INFO nova.api.openstack.requestlog [None req-5dfdf553-c7e3-4ad2-bfa9-3c08a3577bad tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4205fb36-0df5-4c11-b468-89f59d97352c/ips" status: 200 len: 111 microversion: 2.20 time: 0.044640 Apr 23 04:07:09 user devstack@n-api.service[61306]: [pid: 61306|app: 0|req: 140/424] 10.0.0.210 () {64 vars in 1366 bytes} [Sun Apr 23 04:07:09 2023] GET /compute/v2.1/servers/4205fb36-0df5-4c11-b468-89f59d97352c/ips => generated 111 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 23 04:07:11 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi [None req-6a712214-da73-4b87-8a31-e13d79e6382c tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] Calling method '>' {{(pid=61307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 04:07:11 user devstack@n-api.service[61307]: DEBUG nova.compute.api [None req-6a712214-da73-4b87-8a31-e13d79e6382c tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] [instance: 4205fb36-0df5-4c11-b468-89f59d97352c] Fetching instance by UUID {{(pid=61307) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 23 04:07:11 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-6a712214-da73-4b87-8a31-e13d79e6382c tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 04:07:11 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-6a712214-da73-4b87-8a31-e13d79e6382c tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 04:07:11 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-6a712214-da73-4b87-8a31-e13d79e6382c tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 04:07:11 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-6a712214-da73-4b87-8a31-e13d79e6382c tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 04:07:11 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-6a712214-da73-4b87-8a31-e13d79e6382c tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 04:07:11 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-6a712214-da73-4b87-8a31-e13d79e6382c tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 04:07:11 user devstack@n-api.service[61307]: DEBUG nova.compute.api [None req-6a712214-da73-4b87-8a31-e13d79e6382c tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] [instance: 4205fb36-0df5-4c11-b468-89f59d97352c] Going to try to terminate instance {{(pid=61307) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 23 04:07:11 user devstack@n-api.service[61307]: INFO nova.api.openstack.requestlog [None req-6a712214-da73-4b87-8a31-e13d79e6382c tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/4205fb36-0df5-4c11-b468-89f59d97352c" status: 204 len: 0 microversion: 2.20 time: 0.107899 Apr 23 04:07:11 user devstack@n-api.service[61307]: [pid: 61307|app: 0|req: 142/425] 10.0.0.210 () {64 vars in 1357 bytes} [Sun Apr 23 04:07:11 2023] DELETE /compute/v2.1/servers/4205fb36-0df5-4c11-b468-89f59d97352c => generated 0 bytes in 109 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 23 04:07:11 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi [None req-5b5e647c-3f7c-431f-a5e9-f957ae307dee tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] Calling method '>' {{(pid=61308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 04:07:11 user devstack@n-api.service[61308]: DEBUG nova.compute.api [None req-5b5e647c-3f7c-431f-a5e9-f957ae307dee tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] [instance: 4205fb36-0df5-4c11-b468-89f59d97352c] Fetching instance by UUID {{(pid=61308) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 23 04:07:11 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-5b5e647c-3f7c-431f-a5e9-f957ae307dee tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 04:07:11 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-5b5e647c-3f7c-431f-a5e9-f957ae307dee tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 04:07:11 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-5b5e647c-3f7c-431f-a5e9-f957ae307dee tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 04:07:11 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-5b5e647c-3f7c-431f-a5e9-f957ae307dee tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 04:07:11 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-5b5e647c-3f7c-431f-a5e9-f957ae307dee tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 04:07:11 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-5b5e647c-3f7c-431f-a5e9-f957ae307dee tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 04:07:11 user devstack@n-api.service[61308]: DEBUG nova.policy [None req-5b5e647c-3f7c-431f-a5e9-f957ae307dee tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929f88dec4234641a37fdda799108cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d84d2e6776c4ac38b90b752a36600c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61308) authorize /opt/stack/nova/nova/policy.py:203}} Apr 23 04:07:12 user devstack@n-api.service[61308]: DEBUG nova.policy [None req-5b5e647c-3f7c-431f-a5e9-f957ae307dee tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '929f88dec4234641a37fdda799108cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d84d2e6776c4ac38b90b752a36600c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61308) authorize /opt/stack/nova/nova/policy.py:203}} Apr 23 04:07:12 user devstack@n-api.service[61308]: DEBUG nova.policy [None req-5b5e647c-3f7c-431f-a5e9-f957ae307dee tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '929f88dec4234641a37fdda799108cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d84d2e6776c4ac38b90b752a36600c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61308) authorize /opt/stack/nova/nova/policy.py:203}} Apr 23 04:07:12 user devstack@n-api.service[61308]: INFO nova.api.openstack.requestlog [None req-5b5e647c-3f7c-431f-a5e9-f957ae307dee tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4205fb36-0df5-4c11-b468-89f59d97352c" status: 200 len: 1712 microversion: 2.20 time: 0.580287 Apr 23 04:07:12 user devstack@n-api.service[61308]: [pid: 61308|app: 0|req: 144/426] 10.0.0.210 () {64 vars in 1354 bytes} [Sun Apr 23 04:07:11 2023] GET /compute/v2.1/servers/4205fb36-0df5-4c11-b468-89f59d97352c => generated 1712 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 23 04:07:12 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi [req-87d12946-81d2-4c1f-a741-404107736e2d req-b811c349-0fcd-4564-a1a5-9c2283efa795 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4205fb36-0df5-4c11-b468-89f59d97352c", "name": "network-vif-unplugged", "status": "completed", "tag": "bb5db91e-75d7-4a5c-90c4-66035e0f7628"}]} {{(pid=61306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 04:07:12 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [req-87d12946-81d2-4c1f-a741-404107736e2d req-b811c349-0fcd-4564-a1a5-9c2283efa795 service nova] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 04:07:12 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [req-87d12946-81d2-4c1f-a741-404107736e2d req-b811c349-0fcd-4564-a1a5-9c2283efa795 service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 04:07:12 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [req-87d12946-81d2-4c1f-a741-404107736e2d req-b811c349-0fcd-4564-a1a5-9c2283efa795 service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 04:07:12 user devstack@n-api.service[61306]: INFO nova.api.openstack.compute.server_external_events [req-87d12946-81d2-4c1f-a741-404107736e2d req-b811c349-0fcd-4564-a1a5-9c2283efa795 service nova] Creating event network-vif-unplugged:bb5db91e-75d7-4a5c-90c4-66035e0f7628 for instance 4205fb36-0df5-4c11-b468-89f59d97352c on user Apr 23 04:07:12 user devstack@n-api.service[61306]: INFO nova.api.openstack.requestlog [req-87d12946-81d2-4c1f-a741-404107736e2d req-b811c349-0fcd-4564-a1a5-9c2283efa795 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031117 Apr 23 04:07:12 user devstack@n-api.service[61306]: [pid: 61306|app: 0|req: 141/427] 10.0.0.210 () {68 vars in 1394 bytes} [Sun Apr 23 04:07:12 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 23 04:07:12 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi [None req-9ea2d4f5-5c14-40fd-9ce5-62e64204f4d3 tempest-SnapshotDataIntegrityTests-64123451 tempest-SnapshotDataIntegrityTests-64123451-project-member] Calling method '>' {{(pid=61307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 04:07:12 user devstack@n-api.service[61307]: DEBUG nova.compute.api [None req-9ea2d4f5-5c14-40fd-9ce5-62e64204f4d3 tempest-SnapshotDataIntegrityTests-64123451 tempest-SnapshotDataIntegrityTests-64123451-project-member] [instance: 8171e321-666d-44fc-a0ef-b297ec22369b] Fetching instance by UUID {{(pid=61307) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 23 04:07:12 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-9ea2d4f5-5c14-40fd-9ce5-62e64204f4d3 tempest-SnapshotDataIntegrityTests-64123451 tempest-SnapshotDataIntegrityTests-64123451-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 04:07:12 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-9ea2d4f5-5c14-40fd-9ce5-62e64204f4d3 tempest-SnapshotDataIntegrityTests-64123451 tempest-SnapshotDataIntegrityTests-64123451-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 04:07:12 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-9ea2d4f5-5c14-40fd-9ce5-62e64204f4d3 tempest-SnapshotDataIntegrityTests-64123451 tempest-SnapshotDataIntegrityTests-64123451-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 04:07:12 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-9ea2d4f5-5c14-40fd-9ce5-62e64204f4d3 tempest-SnapshotDataIntegrityTests-64123451 tempest-SnapshotDataIntegrityTests-64123451-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 04:07:12 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-9ea2d4f5-5c14-40fd-9ce5-62e64204f4d3 tempest-SnapshotDataIntegrityTests-64123451 tempest-SnapshotDataIntegrityTests-64123451-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 04:07:12 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-9ea2d4f5-5c14-40fd-9ce5-62e64204f4d3 tempest-SnapshotDataIntegrityTests-64123451 tempest-SnapshotDataIntegrityTests-64123451-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 04:07:12 user devstack@n-api.service[61307]: DEBUG nova.policy [None req-9ea2d4f5-5c14-40fd-9ce5-62e64204f4d3 tempest-SnapshotDataIntegrityTests-64123451 tempest-SnapshotDataIntegrityTests-64123451-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c452706dd7dc4f54b45e9f959288bd6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7eb2f69eab54dd8aac3e6cca9d5e46a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61307) authorize /opt/stack/nova/nova/policy.py:203}} Apr 23 04:07:12 user devstack@n-api.service[61307]: INFO nova.api.openstack.requestlog [None req-9ea2d4f5-5c14-40fd-9ce5-62e64204f4d3 tempest-SnapshotDataIntegrityTests-64123451 tempest-SnapshotDataIntegrityTests-64123451-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8171e321-666d-44fc-a0ef-b297ec22369b" status: 200 len: 1567 microversion: 2.1 time: 0.206090 Apr 23 04:07:12 user devstack@n-api.service[61307]: [pid: 61307|app: 0|req: 143/428] 10.0.0.210 () {62 vars in 1313 bytes} [Sun Apr 23 04:07:12 2023] GET /compute/v2.1/servers/8171e321-666d-44fc-a0ef-b297ec22369b => generated 1567 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 23 04:07:12 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi [req-c7241f66-5f89-41c8-b3f9-c1e4240dfd87 req-5b0b02d2-194d-4246-8130-e1256c1dbb1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4205fb36-0df5-4c11-b468-89f59d97352c", "name": "network-vif-deleted", "tag": "bb5db91e-75d7-4a5c-90c4-66035e0f7628"}]} {{(pid=61308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 04:07:12 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [req-c7241f66-5f89-41c8-b3f9-c1e4240dfd87 req-5b0b02d2-194d-4246-8130-e1256c1dbb1a service nova] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 04:07:12 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [req-c7241f66-5f89-41c8-b3f9-c1e4240dfd87 req-5b0b02d2-194d-4246-8130-e1256c1dbb1a service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 04:07:12 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [req-c7241f66-5f89-41c8-b3f9-c1e4240dfd87 req-5b0b02d2-194d-4246-8130-e1256c1dbb1a service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 04:07:12 user devstack@n-api.service[61308]: INFO nova.api.openstack.compute.server_external_events [req-c7241f66-5f89-41c8-b3f9-c1e4240dfd87 req-5b0b02d2-194d-4246-8130-e1256c1dbb1a service nova] Creating event network-vif-deleted:bb5db91e-75d7-4a5c-90c4-66035e0f7628 for instance 4205fb36-0df5-4c11-b468-89f59d97352c on user Apr 23 04:07:12 user devstack@n-api.service[61308]: INFO nova.api.openstack.requestlog [req-c7241f66-5f89-41c8-b3f9-c1e4240dfd87 req-5b0b02d2-194d-4246-8130-e1256c1dbb1a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032156 Apr 23 04:07:12 user devstack@n-api.service[61308]: [pid: 61308|app: 0|req: 145/429] 10.0.0.210 () {68 vars in 1394 bytes} [Sun Apr 23 04:07:12 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 23 04:07:14 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi [req-33c211d0-17e4-4beb-af82-6c635ff18507 req-131e55f8-2468-4167-9c5a-31d135431a7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4205fb36-0df5-4c11-b468-89f59d97352c", "name": "network-vif-plugged", "status": "completed", "tag": "bb5db91e-75d7-4a5c-90c4-66035e0f7628"}]} {{(pid=61306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 04:07:14 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [req-33c211d0-17e4-4beb-af82-6c635ff18507 req-131e55f8-2468-4167-9c5a-31d135431a7c service nova] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 04:07:14 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [req-33c211d0-17e4-4beb-af82-6c635ff18507 req-131e55f8-2468-4167-9c5a-31d135431a7c service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 04:07:14 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [req-33c211d0-17e4-4beb-af82-6c635ff18507 req-131e55f8-2468-4167-9c5a-31d135431a7c service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 04:07:14 user devstack@n-api.service[61306]: INFO nova.api.openstack.compute.server_external_events [req-33c211d0-17e4-4beb-af82-6c635ff18507 req-131e55f8-2468-4167-9c5a-31d135431a7c service nova] Creating event network-vif-plugged:bb5db91e-75d7-4a5c-90c4-66035e0f7628 for instance 4205fb36-0df5-4c11-b468-89f59d97352c on user Apr 23 04:07:14 user devstack@n-api.service[61306]: INFO nova.api.openstack.requestlog [req-33c211d0-17e4-4beb-af82-6c635ff18507 req-131e55f8-2468-4167-9c5a-31d135431a7c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029222 Apr 23 04:07:14 user devstack@n-api.service[61306]: [pid: 61306|app: 0|req: 142/430] 10.0.0.210 () {68 vars in 1394 bytes} [Sun Apr 23 04:07:14 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 23 04:08:02 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi [None req-519497df-cf4f-4ac2-b2e1-222829c1f293 tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] Calling method '>' {{(pid=61307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 04:08:02 user devstack@n-api.service[61307]: DEBUG nova.compute.api [None req-519497df-cf4f-4ac2-b2e1-222829c1f293 tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] [instance: 4205fb36-0df5-4c11-b468-89f59d97352c] Fetching instance by UUID {{(pid=61307) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 23 04:08:02 user devstack@n-api.service[61307]: DEBUG dbcounter [-] [61307] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=61307) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 04:08:02 user devstack@n-api.service[61307]: DEBUG dbcounter [-] [61307] Writing DB stats nova_cell1:SELECT=25,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61307) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 04:08:02 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-519497df-cf4f-4ac2-b2e1-222829c1f293 tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 04:08:02 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-519497df-cf4f-4ac2-b2e1-222829c1f293 tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 04:08:02 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-519497df-cf4f-4ac2-b2e1-222829c1f293 tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 04:08:02 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-519497df-cf4f-4ac2-b2e1-222829c1f293 tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 04:08:02 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-519497df-cf4f-4ac2-b2e1-222829c1f293 tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 04:08:02 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-519497df-cf4f-4ac2-b2e1-222829c1f293 tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 04:08:02 user devstack@n-api.service[61307]: INFO nova.api.openstack.wsgi [None req-519497df-cf4f-4ac2-b2e1-222829c1f293 tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] HTTP exception thrown: Instance 4205fb36-0df5-4c11-b468-89f59d97352c could not be found. Apr 23 04:08:02 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi [None req-519497df-cf4f-4ac2-b2e1-222829c1f293 tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] Request method failure captured: Apr 23 04:08:02 user devstack@n-api.service[61307]: request: GET /compute/v2.1/servers/4205fb36-0df5-4c11-b468-89f59d97352c HTTP/1.1 Apr 23 04:08:02 user devstack@n-api.service[61307]: Accept: application/json Apr 23 04:08:02 user devstack@n-api.service[61307]: Accept-Encoding: identity Apr 23 04:08:02 user devstack@n-api.service[61307]: Connection: close Apr 23 04:08:02 user devstack@n-api.service[61307]: Content-Length: 0 Apr 23 04:08:02 user devstack@n-api.service[61307]: Content-Type: application/json Apr 23 04:08:02 user devstack@n-api.service[61307]: Host: 10.0.0.210 Apr 23 04:08:02 user devstack@n-api.service[61307]: Openstack-System-Scope: None Apr 23 04:08:02 user devstack@n-api.service[61307]: User-Agent: python-urllib3/1.26.15 Apr 23 04:08:02 user devstack@n-api.service[61307]: X-Auth-Token: gAAAAABkRK57iHgBWhBr7oDpNVFk09r9LkBMLJJvLUDSAB35CE4DR6LQUcoSG_MgoXOReh7P7cRjjTvhSXqG3zBWun0b0IiY3L6kl45ZnSEItShYRvU-Vju8srqNOxIHR6NgMoApmgrMt7TjIq1s8-6piWDQTSwCsUa-UWl-mg7ZtxilZiL_w1U Apr 23 04:08:02 user devstack@n-api.service[61307]: X-Domain-Id: None Apr 23 04:08:02 user devstack@n-api.service[61307]: X-Domain-Name: None Apr 23 04:08:02 user devstack@n-api.service[61307]: X-Identity-Status: Confirmed Apr 23 04:08:02 user devstack@n-api.service[61307]: X-Is-Admin-Project: True Apr 23 04:08:02 user devstack@n-api.service[61307]: X-Openstack-Nova-Api-Version: 2.20 Apr 23 04:08:02 user devstack@n-api.service[61307]: X-Project-Domain-Id: default Apr 23 04:08:02 user devstack@n-api.service[61307]: X-Project-Domain-Name: Default Apr 23 04:08:02 user devstack@n-api.service[61307]: X-Project-Id: 7d84d2e6776c4ac38b90b752a36600c3 Apr 23 04:08:02 user devstack@n-api.service[61307]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1622749322 Apr 23 04:08:02 user devstack@n-api.service[61307]: X-Role: reader,member Apr 23 04:08:02 user devstack@n-api.service[61307]: X-Roles: reader,member Apr 23 04:08:02 user devstack@n-api.service[61307]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7d84d2e6776c4ac38b90b752a36600c3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7d84d2e6776c4ac38b90b752a36600c3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/7d84d2e6776c4ac38b90b752a36600c3"}]}] Apr 23 04:08:02 user devstack@n-api.service[61307]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1622749322 Apr 23 04:08:02 user devstack@n-api.service[61307]: X-Tenant-Id: 7d84d2e6776c4ac38b90b752a36600c3 Apr 23 04:08:02 user devstack@n-api.service[61307]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1622749322 Apr 23 04:08:02 user devstack@n-api.service[61307]: X-User: tempest-AttachVolumeShelveTestJSON-1622749322-project-member Apr 23 04:08:02 user devstack@n-api.service[61307]: X-User-Domain-Id: default Apr 23 04:08:02 user devstack@n-api.service[61307]: X-User-Domain-Name: Default Apr 23 04:08:02 user devstack@n-api.service[61307]: X-User-Id: 929f88dec4234641a37fdda799108cf2 Apr 23 04:08:02 user devstack@n-api.service[61307]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1622749322-project-member Apr 23 04:08:02 user devstack@n-api.service[61307]: method: > Apr 23 04:08:02 user devstack@n-api.service[61307]: exception: Instance 4205fb36-0df5-4c11-b468-89f59d97352c could not be found. Apr 23 04:08:02 user devstack@n-api.service[61307]: action_args: {'id': '4205fb36-0df5-4c11-b468-89f59d97352c'} Apr 23 04:08:02 user devstack@n-api.service[61307]: {{(pid=61307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 23 04:08:02 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 23 04:08:02 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 23 04:08:02 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 23 04:08:02 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 23 04:08:02 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 23 04:08:02 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 23 04:08:02 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 23 04:08:02 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 23 04:08:02 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 23 04:08:02 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4205fb36-0df5-4c11-b468-89f59d97352c could not be found. Apr 23 04:08:02 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi Apr 23 04:08:02 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 23 04:08:02 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi Apr 23 04:08:02 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 23 04:08:02 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 23 04:08:02 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 23 04:08:02 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 23 04:08:02 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 23 04:08:02 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 23 04:08:02 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 23 04:08:02 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 23 04:08:02 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 23 04:08:02 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 23 04:08:02 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 23 04:08:02 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 23 04:08:02 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 23 04:08:02 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4205fb36-0df5-4c11-b468-89f59d97352c could not be found. Apr 23 04:08:02 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi Apr 23 04:08:02 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 23 04:08:02 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi Apr 23 04:08:02 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 23 04:08:02 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 23 04:08:02 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 23 04:08:02 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 23 04:08:02 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 23 04:08:02 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4205fb36-0df5-4c11-b468-89f59d97352c could not be found. Apr 23 04:08:02 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi Apr 23 04:08:02 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi [None req-519497df-cf4f-4ac2-b2e1-222829c1f293 tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] Returning 404 to user: Instance 4205fb36-0df5-4c11-b468-89f59d97352c could not be found. {{(pid=61307) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 23 04:08:02 user devstack@n-api.service[61307]: INFO nova.api.openstack.requestlog [None req-519497df-cf4f-4ac2-b2e1-222829c1f293 tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4205fb36-0df5-4c11-b468-89f59d97352c" status: 404 len: 111 microversion: 2.20 time: 0.033885 Apr 23 04:08:02 user devstack@n-api.service[61307]: [pid: 61307|app: 0|req: 144/431] 10.0.0.210 () {64 vars in 1354 bytes} [Sun Apr 23 04:08:02 2023] GET /compute/v2.1/servers/4205fb36-0df5-4c11-b468-89f59d97352c => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 23 04:08:02 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi [None req-7175de3a-2057-44a0-a57b-8519a5405a7e tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] Calling method '.version_select at 0x7f21e10d6c20>' {{(pid=61308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 04:08:02 user devstack@n-api.service[61308]: DEBUG dbcounter [-] [61308] Writing DB stats nova_api:SELECT=6 {{(pid=61308) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 04:08:02 user devstack@n-api.service[61308]: DEBUG dbcounter [-] [61308] Writing DB stats nova_cell1:SELECT=10 {{(pid=61308) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 04:08:02 user devstack@n-api.service[61308]: INFO nova.api.openstack.requestlog [None req-7175de3a-2057-44a0-a57b-8519a5405a7e tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-679082328" status: 204 len: 0 microversion: 2.20 time: 0.028051 Apr 23 04:08:02 user devstack@n-api.service[61308]: [pid: 61308|app: 0|req: 146/432] 10.0.0.210 () {64 vars in 1336 bytes} [Sun Apr 23 04:08:02 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-679082328 => generated 0 bytes in 29 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 23 04:08:02 user devstack@n-api.service[61306]: DEBUG dbcounter [-] [61306] Writing DB stats nova_api:SELECT=6 {{(pid=61306) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 04:08:02 user devstack@n-api.service[61306]: DEBUG dbcounter [-] [61306] Writing DB stats nova_cell1:SELECT=8 {{(pid=61306) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 04:08:02 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi [None req-dbbe828a-7bd4-4fe5-93ea-9575f6aa5bec tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] Action: 'create', calling method: .version_select at 0x7f21e12b11b0>, body: {"keypair": {"name": "tempest-keypair-911657479", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBLaxA+1Weh2HPeZq1FfwnTWJ4BZ8EwnjCZzkTMH7vd1FpYkudJNqvSYFJUarAtJBTeATbAP1ryV5lwSJmvcK7bPPAXyowr2p/BTQS9EUQ/tnhqgthSuv9uMBFC3mW38WQ=="}} {{(pid=61306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 04:08:02 user devstack@n-api.service[61306]: DEBUG nova.quota [None req-dbbe828a-7bd4-4fe5-93ea-9575f6aa5bec tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] Getting quotas for project 7d84d2e6776c4ac38b90b752a36600c3. Resources: {'key_pairs'} {{(pid=61306) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 23 04:08:02 user devstack@n-api.service[61306]: DEBUG nova.quota [None req-dbbe828a-7bd4-4fe5-93ea-9575f6aa5bec tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] Getting quotas for user 929f88dec4234641a37fdda799108cf2 and project 7d84d2e6776c4ac38b90b752a36600c3. Resources: {'key_pairs'} {{(pid=61306) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 23 04:08:02 user devstack@n-api.service[61306]: INFO nova.api.openstack.requestlog [None req-dbbe828a-7bd4-4fe5-93ea-9575f6aa5bec tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.058987 Apr 23 04:08:02 user devstack@n-api.service[61306]: [pid: 61306|app: 0|req: 143/433] 10.0.0.210 () {66 vars in 1277 bytes} [Sun Apr 23 04:08:02 2023] POST /compute/v2.1/os-keypairs => generated 400 bytes in 61 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 23 04:08:04 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi [None req-b5fe2f7c-67cf-4c3c-a2f3-8520bf7410c8 tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1737853671", "imageRef": "e6127373-9931-4277-9458-eceef653ea1e", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "cf3a95ac-e77f-4ee9-ba56-283fc32b7f8b"}], "security_groups": [{"name": "tempest-securitygroup--1076153321"}], "key_name": "tempest-keypair-911657479", "user_data": "}} {{(pid=61307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 04:08:04 user devstack@n-api.service[61307]: DEBUG nova.network.neutron [None req-b5fe2f7c-67cf-4c3c-a2f3-8520bf7410c8 tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] validate_networks() for [('cf3a95ac-e77f-4ee9-ba56-283fc32b7f8b', None, None, None, None, None)] {{(pid=61307) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 23 04:08:05 user devstack@n-api.service[61307]: DEBUG nova.virt.hardware [None req-b5fe2f7c-67cf-4c3c-a2f3-8520bf7410c8 tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] Flavor limits 0:0:0 {{(pid=61307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 23 04:08:05 user devstack@n-api.service[61307]: DEBUG nova.virt.hardware [None req-b5fe2f7c-67cf-4c3c-a2f3-8520bf7410c8 tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] Image limits 0:0:0 {{(pid=61307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 23 04:08:05 user devstack@n-api.service[61307]: DEBUG nova.virt.hardware [None req-b5fe2f7c-67cf-4c3c-a2f3-8520bf7410c8 tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] Flavor pref 0:0:0 {{(pid=61307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 23 04:08:05 user devstack@n-api.service[61307]: DEBUG nova.virt.hardware [None req-b5fe2f7c-67cf-4c3c-a2f3-8520bf7410c8 tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] Image pref 0:0:0 {{(pid=61307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 23 04:08:05 user devstack@n-api.service[61307]: DEBUG nova.virt.hardware [None req-b5fe2f7c-67cf-4c3c-a2f3-8520bf7410c8 tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 23 04:08:05 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-b5fe2f7c-67cf-4c3c-a2f3-8520bf7410c8 tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 04:08:05 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-b5fe2f7c-67cf-4c3c-a2f3-8520bf7410c8 tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 04:08:05 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-b5fe2f7c-67cf-4c3c-a2f3-8520bf7410c8 tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 04:08:05 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-b5fe2f7c-67cf-4c3c-a2f3-8520bf7410c8 tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 04:08:05 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-b5fe2f7c-67cf-4c3c-a2f3-8520bf7410c8 tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 04:08:05 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-b5fe2f7c-67cf-4c3c-a2f3-8520bf7410c8 tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 04:08:05 user devstack@n-api.service[61307]: DEBUG nova.quota [None req-b5fe2f7c-67cf-4c3c-a2f3-8520bf7410c8 tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] Getting quotas for project 7d84d2e6776c4ac38b90b752a36600c3. Resources: {'ram', 'instances', 'cores'} {{(pid=61307) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 23 04:08:05 user devstack@n-api.service[61307]: DEBUG nova.quota [None req-b5fe2f7c-67cf-4c3c-a2f3-8520bf7410c8 tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] Getting quotas for user 929f88dec4234641a37fdda799108cf2 and project 7d84d2e6776c4ac38b90b752a36600c3. Resources: {'ram', 'instances', 'cores'} {{(pid=61307) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 23 04:08:05 user devstack@n-api.service[61307]: DEBUG nova.compute.api [None req-b5fe2f7c-67cf-4c3c-a2f3-8520bf7410c8 tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] Going to run 1 instances... {{(pid=61307) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 23 04:08:05 user devstack@n-api.service[61307]: DEBUG nova.compute.api [None req-b5fe2f7c-67cf-4c3c-a2f3-8520bf7410c8 tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] [instance: b04c49a4-646d-43aa-96ea-d835bf673e42] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e6127373-9931-4277-9458-eceef653ea1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61307) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 23 04:08:05 user devstack@n-api.service[61307]: INFO nova.api.openstack.requestlog [None req-b5fe2f7c-67cf-4c3c-a2f3-8520bf7410c8 tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.20 time: 0.853195 Apr 23 04:08:05 user devstack@n-api.service[61307]: [pid: 61307|app: 0|req: 145/434] 10.0.0.210 () {66 vars in 1265 bytes} [Sun Apr 23 04:08:04 2023] POST /compute/v2.1/servers => generated 400 bytes in 855 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 23 04:08:05 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi [None req-22c46e22-4769-4491-9559-62a679159d0e tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] Calling method '>' {{(pid=61308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 04:08:05 user devstack@n-api.service[61308]: DEBUG nova.compute.api [None req-22c46e22-4769-4491-9559-62a679159d0e tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] [instance: b04c49a4-646d-43aa-96ea-d835bf673e42] Fetching instance by UUID {{(pid=61308) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 23 04:08:05 user devstack@n-api.service[61308]: DEBUG nova.policy [None req-22c46e22-4769-4491-9559-62a679159d0e tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929f88dec4234641a37fdda799108cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d84d2e6776c4ac38b90b752a36600c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61308) authorize /opt/stack/nova/nova/policy.py:203}} Apr 23 04:08:05 user devstack@n-api.service[61308]: DEBUG nova.policy [None req-22c46e22-4769-4491-9559-62a679159d0e tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '929f88dec4234641a37fdda799108cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d84d2e6776c4ac38b90b752a36600c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61308) authorize /opt/stack/nova/nova/policy.py:203}} Apr 23 04:08:05 user devstack@n-api.service[61308]: DEBUG nova.policy [None req-22c46e22-4769-4491-9559-62a679159d0e tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '929f88dec4234641a37fdda799108cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d84d2e6776c4ac38b90b752a36600c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61308) authorize /opt/stack/nova/nova/policy.py:203}} Apr 23 04:08:05 user devstack@n-api.service[61308]: INFO nova.api.openstack.requestlog [None req-22c46e22-4769-4491-9559-62a679159d0e tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b04c49a4-646d-43aa-96ea-d835bf673e42" status: 200 len: 1275 microversion: 2.20 time: 0.119153 Apr 23 04:08:05 user devstack@n-api.service[61308]: [pid: 61308|app: 0|req: 147/435] 10.0.0.210 () {64 vars in 1354 bytes} [Sun Apr 23 04:08:05 2023] GET /compute/v2.1/servers/b04c49a4-646d-43aa-96ea-d835bf673e42 => generated 1275 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 23 04:08:07 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi [req-b1da0f43-3fae-470f-838d-c9b83c6a3ca6 req-41c810d1-7576-4dc9-98fc-c39b8f63d127 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b04c49a4-646d-43aa-96ea-d835bf673e42", "tag": "1b9a901a-8358-4b1c-89a7-de0772c2697e"}]} {{(pid=61306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 04:08:07 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [req-b1da0f43-3fae-470f-838d-c9b83c6a3ca6 req-41c810d1-7576-4dc9-98fc-c39b8f63d127 service nova] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 04:08:07 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [req-b1da0f43-3fae-470f-838d-c9b83c6a3ca6 req-41c810d1-7576-4dc9-98fc-c39b8f63d127 service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 04:08:07 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [req-b1da0f43-3fae-470f-838d-c9b83c6a3ca6 req-41c810d1-7576-4dc9-98fc-c39b8f63d127 service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 04:08:07 user devstack@n-api.service[61306]: INFO nova.api.openstack.compute.server_external_events [req-b1da0f43-3fae-470f-838d-c9b83c6a3ca6 req-41c810d1-7576-4dc9-98fc-c39b8f63d127 service nova] Creating event network-changed:1b9a901a-8358-4b1c-89a7-de0772c2697e for instance b04c49a4-646d-43aa-96ea-d835bf673e42 on user Apr 23 04:08:07 user devstack@n-api.service[61306]: INFO nova.api.openstack.requestlog [req-b1da0f43-3fae-470f-838d-c9b83c6a3ca6 req-41c810d1-7576-4dc9-98fc-c39b8f63d127 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030096 Apr 23 04:08:07 user devstack@n-api.service[61306]: [pid: 61306|app: 0|req: 144/436] 10.0.0.210 () {68 vars in 1394 bytes} [Sun Apr 23 04:08:07 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 23 04:08:09 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi [req-c01071bd-6cfd-479e-9c73-17a9a3e9af22 req-65499a3f-689d-4671-ba34-90a78b9ee86f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b04c49a4-646d-43aa-96ea-d835bf673e42", "name": "network-vif-plugged", "status": "completed", "tag": "1b9a901a-8358-4b1c-89a7-de0772c2697e"}]} {{(pid=61307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 04:08:09 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [req-c01071bd-6cfd-479e-9c73-17a9a3e9af22 req-65499a3f-689d-4671-ba34-90a78b9ee86f service nova] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 04:08:09 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [req-c01071bd-6cfd-479e-9c73-17a9a3e9af22 req-65499a3f-689d-4671-ba34-90a78b9ee86f service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 04:08:09 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [req-c01071bd-6cfd-479e-9c73-17a9a3e9af22 req-65499a3f-689d-4671-ba34-90a78b9ee86f service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 04:08:09 user devstack@n-api.service[61307]: INFO nova.api.openstack.compute.server_external_events [req-c01071bd-6cfd-479e-9c73-17a9a3e9af22 req-65499a3f-689d-4671-ba34-90a78b9ee86f service nova] Creating event network-vif-plugged:1b9a901a-8358-4b1c-89a7-de0772c2697e for instance b04c49a4-646d-43aa-96ea-d835bf673e42 on user Apr 23 04:08:09 user devstack@n-api.service[61307]: INFO nova.api.openstack.requestlog [req-c01071bd-6cfd-479e-9c73-17a9a3e9af22 req-65499a3f-689d-4671-ba34-90a78b9ee86f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033396 Apr 23 04:08:09 user devstack@n-api.service[61307]: [pid: 61307|app: 0|req: 146/437] 10.0.0.210 () {68 vars in 1394 bytes} [Sun Apr 23 04:08:09 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 23 04:08:11 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi [req-744f2257-ee01-47c8-9833-cb9f702e3d11 req-1767bd83-47a0-4033-8b47-2cfc9db84bcb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b04c49a4-646d-43aa-96ea-d835bf673e42", "name": "network-vif-plugged", "status": "completed", "tag": "1b9a901a-8358-4b1c-89a7-de0772c2697e"}]} {{(pid=61308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 04:08:11 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [req-744f2257-ee01-47c8-9833-cb9f702e3d11 req-1767bd83-47a0-4033-8b47-2cfc9db84bcb service nova] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 04:08:11 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [req-744f2257-ee01-47c8-9833-cb9f702e3d11 req-1767bd83-47a0-4033-8b47-2cfc9db84bcb service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 04:08:11 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [req-744f2257-ee01-47c8-9833-cb9f702e3d11 req-1767bd83-47a0-4033-8b47-2cfc9db84bcb service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 04:08:11 user devstack@n-api.service[61308]: INFO nova.api.openstack.compute.server_external_events [req-744f2257-ee01-47c8-9833-cb9f702e3d11 req-1767bd83-47a0-4033-8b47-2cfc9db84bcb service nova] Creating event network-vif-plugged:1b9a901a-8358-4b1c-89a7-de0772c2697e for instance b04c49a4-646d-43aa-96ea-d835bf673e42 on user Apr 23 04:08:11 user devstack@n-api.service[61308]: INFO nova.api.openstack.requestlog [req-744f2257-ee01-47c8-9833-cb9f702e3d11 req-1767bd83-47a0-4033-8b47-2cfc9db84bcb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049804 Apr 23 04:08:11 user devstack@n-api.service[61308]: [pid: 61308|app: 0|req: 148/438] 10.0.0.210 () {68 vars in 1394 bytes} [Sun Apr 23 04:08:11 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 23 04:08:12 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi [None req-ee80ab1c-cffd-4954-92b8-2e50a4d8584d tempest-SnapshotDataIntegrityTests-64123451 tempest-SnapshotDataIntegrityTests-64123451-project-member] Calling method '>' {{(pid=61306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 04:08:12 user devstack@n-api.service[61306]: DEBUG nova.compute.api [None req-ee80ab1c-cffd-4954-92b8-2e50a4d8584d tempest-SnapshotDataIntegrityTests-64123451 tempest-SnapshotDataIntegrityTests-64123451-project-member] [instance: 8171e321-666d-44fc-a0ef-b297ec22369b] Fetching instance by UUID {{(pid=61306) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 23 04:08:12 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-ee80ab1c-cffd-4954-92b8-2e50a4d8584d tempest-SnapshotDataIntegrityTests-64123451 tempest-SnapshotDataIntegrityTests-64123451-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 04:08:12 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-ee80ab1c-cffd-4954-92b8-2e50a4d8584d tempest-SnapshotDataIntegrityTests-64123451 tempest-SnapshotDataIntegrityTests-64123451-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 04:08:12 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-ee80ab1c-cffd-4954-92b8-2e50a4d8584d tempest-SnapshotDataIntegrityTests-64123451 tempest-SnapshotDataIntegrityTests-64123451-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 04:08:12 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-ee80ab1c-cffd-4954-92b8-2e50a4d8584d tempest-SnapshotDataIntegrityTests-64123451 tempest-SnapshotDataIntegrityTests-64123451-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 04:08:12 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-ee80ab1c-cffd-4954-92b8-2e50a4d8584d tempest-SnapshotDataIntegrityTests-64123451 tempest-SnapshotDataIntegrityTests-64123451-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 04:08:12 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-ee80ab1c-cffd-4954-92b8-2e50a4d8584d tempest-SnapshotDataIntegrityTests-64123451 tempest-SnapshotDataIntegrityTests-64123451-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 04:08:12 user devstack@n-api.service[61306]: DEBUG dbcounter [-] [61306] Writing DB stats nova_cell0:SELECT=4 {{(pid=61306) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 04:08:12 user devstack@n-api.service[61306]: DEBUG nova.policy [None req-ee80ab1c-cffd-4954-92b8-2e50a4d8584d tempest-SnapshotDataIntegrityTests-64123451 tempest-SnapshotDataIntegrityTests-64123451-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c452706dd7dc4f54b45e9f959288bd6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7eb2f69eab54dd8aac3e6cca9d5e46a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61306) authorize /opt/stack/nova/nova/policy.py:203}} Apr 23 04:08:12 user devstack@n-api.service[61306]: INFO nova.api.openstack.requestlog [None req-ee80ab1c-cffd-4954-92b8-2e50a4d8584d tempest-SnapshotDataIntegrityTests-64123451 tempest-SnapshotDataIntegrityTests-64123451-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8171e321-666d-44fc-a0ef-b297ec22369b" status: 200 len: 1567 microversion: 2.1 time: 0.271940 Apr 23 04:08:12 user devstack@n-api.service[61306]: [pid: 61306|app: 0|req: 145/439] 10.0.0.210 () {62 vars in 1313 bytes} [Sun Apr 23 04:08:12 2023] GET /compute/v2.1/servers/8171e321-666d-44fc-a0ef-b297ec22369b => generated 1567 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 23 04:08:14 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi [None req-3f74fe56-632e-4259-80b6-defe80543bca tempest-SnapshotDataIntegrityTests-64123451 tempest-SnapshotDataIntegrityTests-64123451-project-member] Calling method '>' {{(pid=61307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 04:08:14 user devstack@n-api.service[61307]: DEBUG nova.compute.api [None req-3f74fe56-632e-4259-80b6-defe80543bca tempest-SnapshotDataIntegrityTests-64123451 tempest-SnapshotDataIntegrityTests-64123451-project-member] [instance: 8171e321-666d-44fc-a0ef-b297ec22369b] Fetching instance by UUID {{(pid=61307) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 23 04:08:14 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-3f74fe56-632e-4259-80b6-defe80543bca tempest-SnapshotDataIntegrityTests-64123451 tempest-SnapshotDataIntegrityTests-64123451-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 04:08:14 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-3f74fe56-632e-4259-80b6-defe80543bca tempest-SnapshotDataIntegrityTests-64123451 tempest-SnapshotDataIntegrityTests-64123451-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 04:08:14 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-3f74fe56-632e-4259-80b6-defe80543bca tempest-SnapshotDataIntegrityTests-64123451 tempest-SnapshotDataIntegrityTests-64123451-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 04:08:14 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-3f74fe56-632e-4259-80b6-defe80543bca tempest-SnapshotDataIntegrityTests-64123451 tempest-SnapshotDataIntegrityTests-64123451-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 04:08:14 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-3f74fe56-632e-4259-80b6-defe80543bca tempest-SnapshotDataIntegrityTests-64123451 tempest-SnapshotDataIntegrityTests-64123451-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 04:08:14 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-3f74fe56-632e-4259-80b6-defe80543bca tempest-SnapshotDataIntegrityTests-64123451 tempest-SnapshotDataIntegrityTests-64123451-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 04:08:14 user devstack@n-api.service[61307]: DEBUG nova.compute.api [None req-3f74fe56-632e-4259-80b6-defe80543bca tempest-SnapshotDataIntegrityTests-64123451 tempest-SnapshotDataIntegrityTests-64123451-project-member] [instance: 8171e321-666d-44fc-a0ef-b297ec22369b] Going to try to terminate instance {{(pid=61307) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 23 04:08:14 user devstack@n-api.service[61307]: INFO nova.api.openstack.requestlog [None req-3f74fe56-632e-4259-80b6-defe80543bca tempest-SnapshotDataIntegrityTests-64123451 tempest-SnapshotDataIntegrityTests-64123451-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/8171e321-666d-44fc-a0ef-b297ec22369b" status: 204 len: 0 microversion: 2.1 time: 0.105507 Apr 23 04:08:14 user devstack@n-api.service[61307]: [pid: 61307|app: 0|req: 147/440] 10.0.0.210 () {62 vars in 1316 bytes} [Sun Apr 23 04:08:14 2023] DELETE /compute/v2.1/servers/8171e321-666d-44fc-a0ef-b297ec22369b => generated 0 bytes in 107 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 23 04:08:14 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi [None req-c0596380-60f7-4aa4-9341-14d28f3186cb tempest-SnapshotDataIntegrityTests-64123451 tempest-SnapshotDataIntegrityTests-64123451-project-member] Calling method '>' {{(pid=61308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 04:08:14 user devstack@n-api.service[61308]: DEBUG nova.compute.api [None req-c0596380-60f7-4aa4-9341-14d28f3186cb tempest-SnapshotDataIntegrityTests-64123451 tempest-SnapshotDataIntegrityTests-64123451-project-member] [instance: 8171e321-666d-44fc-a0ef-b297ec22369b] Fetching instance by UUID {{(pid=61308) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 23 04:08:14 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-c0596380-60f7-4aa4-9341-14d28f3186cb tempest-SnapshotDataIntegrityTests-64123451 tempest-SnapshotDataIntegrityTests-64123451-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 04:08:14 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-c0596380-60f7-4aa4-9341-14d28f3186cb tempest-SnapshotDataIntegrityTests-64123451 tempest-SnapshotDataIntegrityTests-64123451-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 04:08:14 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-c0596380-60f7-4aa4-9341-14d28f3186cb tempest-SnapshotDataIntegrityTests-64123451 tempest-SnapshotDataIntegrityTests-64123451-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 04:08:14 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-c0596380-60f7-4aa4-9341-14d28f3186cb tempest-SnapshotDataIntegrityTests-64123451 tempest-SnapshotDataIntegrityTests-64123451-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 04:08:14 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-c0596380-60f7-4aa4-9341-14d28f3186cb tempest-SnapshotDataIntegrityTests-64123451 tempest-SnapshotDataIntegrityTests-64123451-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 04:08:14 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-c0596380-60f7-4aa4-9341-14d28f3186cb tempest-SnapshotDataIntegrityTests-64123451 tempest-SnapshotDataIntegrityTests-64123451-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 04:08:14 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi [req-b4417698-428e-4644-9eda-65ddcad0426e req-16191334-68af-46ae-89f2-fdfe8f7a51b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8171e321-666d-44fc-a0ef-b297ec22369b", "name": "network-vif-unplugged", "status": "completed", "tag": "a1a195c9-37d9-45f8-b8dd-989b54c8f2dd"}]} {{(pid=61306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 04:08:14 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [req-b4417698-428e-4644-9eda-65ddcad0426e req-16191334-68af-46ae-89f2-fdfe8f7a51b3 service nova] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 04:08:14 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [req-b4417698-428e-4644-9eda-65ddcad0426e req-16191334-68af-46ae-89f2-fdfe8f7a51b3 service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 04:08:14 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [req-b4417698-428e-4644-9eda-65ddcad0426e req-16191334-68af-46ae-89f2-fdfe8f7a51b3 service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 04:08:14 user devstack@n-api.service[61306]: INFO nova.api.openstack.compute.server_external_events [req-b4417698-428e-4644-9eda-65ddcad0426e req-16191334-68af-46ae-89f2-fdfe8f7a51b3 service nova] Creating event network-vif-unplugged:a1a195c9-37d9-45f8-b8dd-989b54c8f2dd for instance 8171e321-666d-44fc-a0ef-b297ec22369b on user Apr 23 04:08:14 user devstack@n-api.service[61306]: INFO nova.api.openstack.requestlog [req-b4417698-428e-4644-9eda-65ddcad0426e req-16191334-68af-46ae-89f2-fdfe8f7a51b3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029602 Apr 23 04:08:14 user devstack@n-api.service[61306]: [pid: 61306|app: 0|req: 146/441] 10.0.0.210 () {68 vars in 1394 bytes} [Sun Apr 23 04:08:14 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 23 04:08:14 user devstack@n-api.service[61308]: DEBUG nova.policy [None req-c0596380-60f7-4aa4-9341-14d28f3186cb tempest-SnapshotDataIntegrityTests-64123451 tempest-SnapshotDataIntegrityTests-64123451-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c452706dd7dc4f54b45e9f959288bd6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7eb2f69eab54dd8aac3e6cca9d5e46a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61308) authorize /opt/stack/nova/nova/policy.py:203}} Apr 23 04:08:14 user devstack@n-api.service[61308]: INFO nova.api.openstack.requestlog [None req-c0596380-60f7-4aa4-9341-14d28f3186cb tempest-SnapshotDataIntegrityTests-64123451 tempest-SnapshotDataIntegrityTests-64123451-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8171e321-666d-44fc-a0ef-b297ec22369b" status: 200 len: 1573 microversion: 2.1 time: 0.270099 Apr 23 04:08:14 user devstack@n-api.service[61308]: [pid: 61308|app: 0|req: 149/442] 10.0.0.210 () {62 vars in 1313 bytes} [Sun Apr 23 04:08:14 2023] GET /compute/v2.1/servers/8171e321-666d-44fc-a0ef-b297ec22369b => generated 1573 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 23 04:08:16 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi [req-723a6a95-d227-4315-be3f-617f487434f8 req-1a9dd17f-3806-4fe8-99d2-8721ef682f51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8171e321-666d-44fc-a0ef-b297ec22369b", "name": "network-vif-plugged", "status": "completed", "tag": "a1a195c9-37d9-45f8-b8dd-989b54c8f2dd"}, {"server_uuid": "8171e321-666d-44fc-a0ef-b297ec22369b", "name": "network-vif-deleted", "tag": "a1a195c9-37d9-45f8-b8dd-989b54c8f2dd"}]} {{(pid=61307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 04:08:16 user devstack@n-api.service[61307]: DEBUG dbcounter [-] [61307] Writing DB stats nova_cell0:SELECT=2 {{(pid=61307) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 04:08:16 user devstack@n-api.service[61307]: DEBUG dbcounter [-] [61307] Writing DB stats nova_cell0:SELECT=6 {{(pid=61307) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 04:08:16 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [req-723a6a95-d227-4315-be3f-617f487434f8 req-1a9dd17f-3806-4fe8-99d2-8721ef682f51 service nova] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 04:08:16 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [req-723a6a95-d227-4315-be3f-617f487434f8 req-1a9dd17f-3806-4fe8-99d2-8721ef682f51 service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 04:08:16 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [req-723a6a95-d227-4315-be3f-617f487434f8 req-1a9dd17f-3806-4fe8-99d2-8721ef682f51 service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 04:08:16 user devstack@n-api.service[61307]: INFO nova.api.openstack.compute.server_external_events [req-723a6a95-d227-4315-be3f-617f487434f8 req-1a9dd17f-3806-4fe8-99d2-8721ef682f51 service nova] Creating event network-vif-plugged:a1a195c9-37d9-45f8-b8dd-989b54c8f2dd for instance 8171e321-666d-44fc-a0ef-b297ec22369b on user Apr 23 04:08:16 user devstack@n-api.service[61307]: INFO nova.api.openstack.compute.server_external_events [req-723a6a95-d227-4315-be3f-617f487434f8 req-1a9dd17f-3806-4fe8-99d2-8721ef682f51 service nova] Creating event network-vif-deleted:a1a195c9-37d9-45f8-b8dd-989b54c8f2dd for instance 8171e321-666d-44fc-a0ef-b297ec22369b on user Apr 23 04:08:16 user devstack@n-api.service[61307]: INFO nova.api.openstack.requestlog [req-723a6a95-d227-4315-be3f-617f487434f8 req-1a9dd17f-3806-4fe8-99d2-8721ef682f51 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.042869 Apr 23 04:08:16 user devstack@n-api.service[61307]: [pid: 61307|app: 0|req: 148/443] 10.0.0.210 () {68 vars in 1394 bytes} [Sun Apr 23 04:08:16 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 23 04:08:55 user devstack@n-api.service[61306]: DEBUG dbcounter [-] [61306] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=1 {{(pid=61306) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 04:08:55 user devstack@n-api.service[61306]: DEBUG dbcounter [-] [61306] Writing DB stats nova_cell1:SELECT=10 {{(pid=61306) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 04:08:55 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi [None req-d72bfab8-46d3-4a50-87be-a75219a607ee tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] Calling method '>' {{(pid=61306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 04:08:55 user devstack@n-api.service[61306]: DEBUG nova.compute.api [None req-d72bfab8-46d3-4a50-87be-a75219a607ee tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] [instance: b04c49a4-646d-43aa-96ea-d835bf673e42] Fetching instance by UUID {{(pid=61306) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 23 04:08:55 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-d72bfab8-46d3-4a50-87be-a75219a607ee tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 04:08:55 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-d72bfab8-46d3-4a50-87be-a75219a607ee tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 04:08:55 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-d72bfab8-46d3-4a50-87be-a75219a607ee tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 04:08:55 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-d72bfab8-46d3-4a50-87be-a75219a607ee tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 04:08:55 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-d72bfab8-46d3-4a50-87be-a75219a607ee tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 04:08:55 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-d72bfab8-46d3-4a50-87be-a75219a607ee tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 04:08:55 user devstack@n-api.service[61306]: DEBUG nova.policy [None req-d72bfab8-46d3-4a50-87be-a75219a607ee tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929f88dec4234641a37fdda799108cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d84d2e6776c4ac38b90b752a36600c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61306) authorize /opt/stack/nova/nova/policy.py:203}} Apr 23 04:08:55 user devstack@n-api.service[61306]: DEBUG nova.policy [None req-d72bfab8-46d3-4a50-87be-a75219a607ee tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '929f88dec4234641a37fdda799108cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d84d2e6776c4ac38b90b752a36600c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61306) authorize /opt/stack/nova/nova/policy.py:203}} Apr 23 04:08:55 user devstack@n-api.service[61306]: DEBUG nova.policy [None req-d72bfab8-46d3-4a50-87be-a75219a607ee tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '929f88dec4234641a37fdda799108cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d84d2e6776c4ac38b90b752a36600c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61306) authorize /opt/stack/nova/nova/policy.py:203}} Apr 23 04:08:55 user devstack@n-api.service[61306]: INFO nova.api.openstack.requestlog [None req-d72bfab8-46d3-4a50-87be-a75219a607ee tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b04c49a4-646d-43aa-96ea-d835bf673e42" status: 200 len: 1587 microversion: 2.20 time: 0.275602 Apr 23 04:08:55 user devstack@n-api.service[61306]: [pid: 61306|app: 0|req: 147/444] 10.0.0.210 () {64 vars in 1354 bytes} [Sun Apr 23 04:08:55 2023] GET /compute/v2.1/servers/b04c49a4-646d-43aa-96ea-d835bf673e42 => generated 1587 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 23 04:09:04 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi [None req-6bdb0f4b-2be5-4c4c-b668-b6730900c592 tempest-SnapshotDataIntegrityTests-64123451 tempest-SnapshotDataIntegrityTests-64123451-project-member] Calling method '>' {{(pid=61308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 04:09:04 user devstack@n-api.service[61308]: DEBUG nova.compute.api [None req-6bdb0f4b-2be5-4c4c-b668-b6730900c592 tempest-SnapshotDataIntegrityTests-64123451 tempest-SnapshotDataIntegrityTests-64123451-project-member] [instance: 8171e321-666d-44fc-a0ef-b297ec22369b] Fetching instance by UUID {{(pid=61308) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 23 04:09:04 user devstack@n-api.service[61308]: DEBUG dbcounter [-] [61308] Writing DB stats nova_cell0:SELECT=2 {{(pid=61308) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 04:09:04 user devstack@n-api.service[61308]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 23 04:09:04 user devstack@n-api.service[61308]: Sun Apr 23 04:09:04 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8171e321-666d-44fc-a0ef-b297ec22369b (ip 10.0.0.210) !!! Apr 23 04:09:04 user devstack@n-api.service[61308]: DEBUG dbcounter [-] [61308] Writing DB stats nova_api:SELECT=11,nova_api:DELETE=1 {{(pid=61308) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 04:09:04 user devstack@n-api.service[61308]: DEBUG dbcounter [-] [61308] Writing DB stats nova_cell1:SELECT=8 {{(pid=61308) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 04:09:04 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-6bdb0f4b-2be5-4c4c-b668-b6730900c592 tempest-SnapshotDataIntegrityTests-64123451 tempest-SnapshotDataIntegrityTests-64123451-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 04:09:04 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-6bdb0f4b-2be5-4c4c-b668-b6730900c592 tempest-SnapshotDataIntegrityTests-64123451 tempest-SnapshotDataIntegrityTests-64123451-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 04:09:04 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-6bdb0f4b-2be5-4c4c-b668-b6730900c592 tempest-SnapshotDataIntegrityTests-64123451 tempest-SnapshotDataIntegrityTests-64123451-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 04:09:04 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-6bdb0f4b-2be5-4c4c-b668-b6730900c592 tempest-SnapshotDataIntegrityTests-64123451 tempest-SnapshotDataIntegrityTests-64123451-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 04:09:04 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-6bdb0f4b-2be5-4c4c-b668-b6730900c592 tempest-SnapshotDataIntegrityTests-64123451 tempest-SnapshotDataIntegrityTests-64123451-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 04:09:04 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-6bdb0f4b-2be5-4c4c-b668-b6730900c592 tempest-SnapshotDataIntegrityTests-64123451 tempest-SnapshotDataIntegrityTests-64123451-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 04:09:04 user devstack@n-api.service[61308]: INFO nova.api.openstack.wsgi [None req-6bdb0f4b-2be5-4c4c-b668-b6730900c592 tempest-SnapshotDataIntegrityTests-64123451 tempest-SnapshotDataIntegrityTests-64123451-project-member] HTTP exception thrown: Instance 8171e321-666d-44fc-a0ef-b297ec22369b could not be found. Apr 23 04:09:04 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi [None req-6bdb0f4b-2be5-4c4c-b668-b6730900c592 tempest-SnapshotDataIntegrityTests-64123451 tempest-SnapshotDataIntegrityTests-64123451-project-member] Request method failure captured: Apr 23 04:09:04 user devstack@n-api.service[61308]: request: GET /compute/v2.1/servers/8171e321-666d-44fc-a0ef-b297ec22369b HTTP/1.1 Apr 23 04:09:04 user devstack@n-api.service[61308]: Accept: application/json Apr 23 04:09:04 user devstack@n-api.service[61308]: Accept-Encoding: identity Apr 23 04:09:04 user devstack@n-api.service[61308]: Connection: close Apr 23 04:09:04 user devstack@n-api.service[61308]: Content-Length: 0 Apr 23 04:09:04 user devstack@n-api.service[61308]: Content-Type: application/json Apr 23 04:09:04 user devstack@n-api.service[61308]: Host: 10.0.0.210 Apr 23 04:09:04 user devstack@n-api.service[61308]: Openstack-System-Scope: None Apr 23 04:09:04 user devstack@n-api.service[61308]: User-Agent: python-urllib3/1.26.15 Apr 23 04:09:04 user devstack@n-api.service[61308]: X-Auth-Token: gAAAAABkRK619Df-sT1H01xP2u5CO7aO3fzwvMQHhDPWs2vys794owXipwfKRIai6sO8ssrRMwKq4D5Jfq3bD8mdQhVG7ozmgdfuyaOYdC37BO88jeSnMaQCLLoCXy36Y7aFdp2rmo1FPJqUn0skcRg3CkgaP4Tv1PdSze93bFIZugdgOFIjWM4 Apr 23 04:09:04 user devstack@n-api.service[61308]: X-Domain-Id: None Apr 23 04:09:04 user devstack@n-api.service[61308]: X-Domain-Name: None Apr 23 04:09:04 user devstack@n-api.service[61308]: X-Identity-Status: Confirmed Apr 23 04:09:04 user devstack@n-api.service[61308]: X-Is-Admin-Project: True Apr 23 04:09:04 user devstack@n-api.service[61308]: X-Project-Domain-Id: default Apr 23 04:09:04 user devstack@n-api.service[61308]: X-Project-Domain-Name: Default Apr 23 04:09:04 user devstack@n-api.service[61308]: X-Project-Id: f7eb2f69eab54dd8aac3e6cca9d5e46a Apr 23 04:09:04 user devstack@n-api.service[61308]: X-Project-Name: tempest-SnapshotDataIntegrityTests-64123451 Apr 23 04:09:04 user devstack@n-api.service[61308]: X-Role: reader,member Apr 23 04:09:04 user devstack@n-api.service[61308]: X-Roles: reader,member Apr 23 04:09:04 user devstack@n-api.service[61308]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f7eb2f69eab54dd8aac3e6cca9d5e46a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f7eb2f69eab54dd8aac3e6cca9d5e46a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f7eb2f69eab54dd8aac3e6cca9d5e46a"}]}] Apr 23 04:09:04 user devstack@n-api.service[61308]: X-Tenant: tempest-SnapshotDataIntegrityTests-64123451 Apr 23 04:09:04 user devstack@n-api.service[61308]: X-Tenant-Id: f7eb2f69eab54dd8aac3e6cca9d5e46a Apr 23 04:09:04 user devstack@n-api.service[61308]: X-Tenant-Name: tempest-SnapshotDataIntegrityTests-64123451 Apr 23 04:09:04 user devstack@n-api.service[61308]: X-User: tempest-SnapshotDataIntegrityTests-64123451-project-member Apr 23 04:09:04 user devstack@n-api.service[61308]: X-User-Domain-Id: default Apr 23 04:09:04 user devstack@n-api.service[61308]: X-User-Domain-Name: Default Apr 23 04:09:04 user devstack@n-api.service[61308]: X-User-Id: c452706dd7dc4f54b45e9f959288bd6b Apr 23 04:09:04 user devstack@n-api.service[61308]: X-User-Name: tempest-SnapshotDataIntegrityTests-64123451-project-member Apr 23 04:09:04 user devstack@n-api.service[61308]: method: > Apr 23 04:09:04 user devstack@n-api.service[61308]: exception: Instance 8171e321-666d-44fc-a0ef-b297ec22369b could not be found. Apr 23 04:09:04 user devstack@n-api.service[61308]: action_args: {'id': '8171e321-666d-44fc-a0ef-b297ec22369b'} Apr 23 04:09:04 user devstack@n-api.service[61308]: {{(pid=61308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 23 04:09:04 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 23 04:09:04 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 23 04:09:04 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 23 04:09:04 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 23 04:09:04 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 23 04:09:04 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 23 04:09:04 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 23 04:09:04 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 23 04:09:04 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 23 04:09:04 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8171e321-666d-44fc-a0ef-b297ec22369b could not be found. Apr 23 04:09:04 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi Apr 23 04:09:04 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 23 04:09:04 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi Apr 23 04:09:04 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 23 04:09:04 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 23 04:09:04 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 23 04:09:04 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 23 04:09:04 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 23 04:09:04 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 23 04:09:04 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 23 04:09:04 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 23 04:09:04 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 23 04:09:04 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 23 04:09:04 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 23 04:09:04 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 23 04:09:04 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 23 04:09:04 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8171e321-666d-44fc-a0ef-b297ec22369b could not be found. Apr 23 04:09:04 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi Apr 23 04:09:04 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 23 04:09:04 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi Apr 23 04:09:04 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 23 04:09:04 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 23 04:09:04 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 23 04:09:04 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 23 04:09:04 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 23 04:09:04 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8171e321-666d-44fc-a0ef-b297ec22369b could not be found. Apr 23 04:09:04 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi Apr 23 04:09:04 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi [None req-6bdb0f4b-2be5-4c4c-b668-b6730900c592 tempest-SnapshotDataIntegrityTests-64123451 tempest-SnapshotDataIntegrityTests-64123451-project-member] Returning 404 to user: Instance 8171e321-666d-44fc-a0ef-b297ec22369b could not be found. {{(pid=61308) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 23 04:09:04 user devstack@n-api.service[61308]: INFO nova.api.openstack.requestlog [None req-6bdb0f4b-2be5-4c4c-b668-b6730900c592 tempest-SnapshotDataIntegrityTests-64123451 tempest-SnapshotDataIntegrityTests-64123451-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8171e321-666d-44fc-a0ef-b297ec22369b" status: 404 len: 111 microversion: 2.1 time: 0.052034 Apr 23 04:09:04 user devstack@n-api.service[61308]: [pid: 61308|app: 0|req: 150/445] 10.0.0.210 () {62 vars in 1313 bytes} [Sun Apr 23 04:09:04 2023] GET /compute/v2.1/servers/8171e321-666d-44fc-a0ef-b297ec22369b => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 23 04:09:05 user devstack@n-api.service[61307]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 23 04:09:05 user devstack@n-api.service[61307]: Sun Apr 23 04:09:05 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs/tempest-SnapshotDataIntegrityTests-739066652 (ip 10.0.0.210) !!! Apr 23 04:09:05 user devstack@n-api.service[61307]: DEBUG dbcounter [-] [61307] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=61307) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 04:09:05 user devstack@n-api.service[61307]: DEBUG dbcounter [-] [61307] Writing DB stats nova_cell1:SELECT=23,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61307) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 04:09:05 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi [None req-ac713d7e-efb8-4c7b-b112-d7beea4a3c7b tempest-SnapshotDataIntegrityTests-64123451 tempest-SnapshotDataIntegrityTests-64123451-project-member] Calling method '.version_select at 0x7f21e10cd240>' {{(pid=61307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 04:09:05 user devstack@n-api.service[61307]: INFO nova.api.openstack.requestlog [None req-ac713d7e-efb8-4c7b-b112-d7beea4a3c7b tempest-SnapshotDataIntegrityTests-64123451 tempest-SnapshotDataIntegrityTests-64123451-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-SnapshotDataIntegrityTests-739066652" status: 202 len: 0 microversion: 2.1 time: 0.036779 Apr 23 04:09:05 user devstack@n-api.service[61307]: [pid: 61307|app: 0|req: 149/446] 10.0.0.210 () {62 vars in 1352 bytes} [Sun Apr 23 04:09:05 2023] DELETE /compute/v2.1/os-keypairs/tempest-SnapshotDataIntegrityTests-739066652 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 23 04:09:55 user devstack@n-api.service[61306]: DEBUG dbcounter [-] [61306] Writing DB stats nova_api:SELECT=2 {{(pid=61306) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 04:09:55 user devstack@n-api.service[61306]: DEBUG dbcounter [-] [61306] Writing DB stats nova_cell1:SELECT=6 {{(pid=61306) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 04:09:55 user devstack@n-api.service[61306]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 23 04:09:55 user devstack@n-api.service[61306]: Sun Apr 23 04:09:55 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b04c49a4-646d-43aa-96ea-d835bf673e42/os-interface (ip 10.0.0.210) !!! Apr 23 04:09:55 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi [None req-16b7d01e-3238-47b2-acc1-7a1029eba59f tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] Calling method '>' {{(pid=61306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 04:09:55 user devstack@n-api.service[61306]: DEBUG nova.compute.api [None req-16b7d01e-3238-47b2-acc1-7a1029eba59f tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] [instance: b04c49a4-646d-43aa-96ea-d835bf673e42] Fetching instance by UUID {{(pid=61306) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 23 04:09:55 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-16b7d01e-3238-47b2-acc1-7a1029eba59f tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 04:09:55 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-16b7d01e-3238-47b2-acc1-7a1029eba59f tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 04:09:55 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-16b7d01e-3238-47b2-acc1-7a1029eba59f tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 04:09:55 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-16b7d01e-3238-47b2-acc1-7a1029eba59f tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 04:09:55 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-16b7d01e-3238-47b2-acc1-7a1029eba59f tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 04:09:55 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-16b7d01e-3238-47b2-acc1-7a1029eba59f tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 04:09:55 user devstack@n-api.service[61306]: INFO nova.api.openstack.requestlog [None req-16b7d01e-3238-47b2-acc1-7a1029eba59f tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b04c49a4-646d-43aa-96ea-d835bf673e42/os-interface" status: 200 len: 282 microversion: 2.20 time: 0.199648 Apr 23 04:09:55 user devstack@n-api.service[61306]: [pid: 61306|app: 0|req: 148/447] 10.0.0.210 () {64 vars in 1393 bytes} [Sun Apr 23 04:09:55 2023] GET /compute/v2.1/servers/b04c49a4-646d-43aa-96ea-d835bf673e42/os-interface => generated 282 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 23 04:09:56 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi [req-65e08d16-7762-478f-ba9a-471f9ca756e1 req-08a3ac72-d586-4869-945a-7262c5e14e09 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b04c49a4-646d-43aa-96ea-d835bf673e42", "tag": "1b9a901a-8358-4b1c-89a7-de0772c2697e"}]} {{(pid=61308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 04:09:56 user devstack@n-api.service[61308]: DEBUG dbcounter [-] [61308] Writing DB stats nova_cell1:SELECT=2 {{(pid=61308) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 04:09:56 user devstack@n-api.service[61308]: DEBUG dbcounter [-] [61308] Writing DB stats nova_api:SELECT=2 {{(pid=61308) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 04:09:56 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [req-65e08d16-7762-478f-ba9a-471f9ca756e1 req-08a3ac72-d586-4869-945a-7262c5e14e09 service nova] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 04:09:56 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [req-65e08d16-7762-478f-ba9a-471f9ca756e1 req-08a3ac72-d586-4869-945a-7262c5e14e09 service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 04:09:56 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [req-65e08d16-7762-478f-ba9a-471f9ca756e1 req-08a3ac72-d586-4869-945a-7262c5e14e09 service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 04:09:56 user devstack@n-api.service[61308]: INFO nova.api.openstack.compute.server_external_events [req-65e08d16-7762-478f-ba9a-471f9ca756e1 req-08a3ac72-d586-4869-945a-7262c5e14e09 service nova] Creating event network-changed:1b9a901a-8358-4b1c-89a7-de0772c2697e for instance b04c49a4-646d-43aa-96ea-d835bf673e42 on user Apr 23 04:09:56 user devstack@n-api.service[61308]: INFO nova.api.openstack.requestlog [req-65e08d16-7762-478f-ba9a-471f9ca756e1 req-08a3ac72-d586-4869-945a-7262c5e14e09 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037474 Apr 23 04:09:56 user devstack@n-api.service[61308]: [pid: 61308|app: 0|req: 151/448] 10.0.0.210 () {68 vars in 1394 bytes} [Sun Apr 23 04:09:56 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 23 04:09:56 user devstack@n-api.service[61307]: DEBUG dbcounter [-] [61307] Writing DB stats nova_api:SELECT=3,nova_api:DELETE=1 {{(pid=61307) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 04:09:56 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi [None req-76a33cf4-e948-4388-a06e-5028d270ac1e tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] Calling method '>' {{(pid=61307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 04:09:56 user devstack@n-api.service[61307]: DEBUG nova.compute.api [None req-76a33cf4-e948-4388-a06e-5028d270ac1e tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] [instance: b04c49a4-646d-43aa-96ea-d835bf673e42] Fetching instance by UUID {{(pid=61307) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 23 04:09:56 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-76a33cf4-e948-4388-a06e-5028d270ac1e tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 04:09:56 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-76a33cf4-e948-4388-a06e-5028d270ac1e tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 04:09:56 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-76a33cf4-e948-4388-a06e-5028d270ac1e tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 04:09:56 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-76a33cf4-e948-4388-a06e-5028d270ac1e tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 04:09:56 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-76a33cf4-e948-4388-a06e-5028d270ac1e tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 04:09:56 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-76a33cf4-e948-4388-a06e-5028d270ac1e tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 04:09:56 user devstack@n-api.service[61307]: INFO nova.api.openstack.requestlog [None req-76a33cf4-e948-4388-a06e-5028d270ac1e tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b04c49a4-646d-43aa-96ea-d835bf673e42/ips" status: 200 len: 110 microversion: 2.20 time: 0.053086 Apr 23 04:09:56 user devstack@n-api.service[61307]: [pid: 61307|app: 0|req: 150/449] 10.0.0.210 () {64 vars in 1366 bytes} [Sun Apr 23 04:09:56 2023] GET /compute/v2.1/servers/b04c49a4-646d-43aa-96ea-d835bf673e42/ips => generated 110 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 23 04:09:58 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi [None req-94f073b6-24e2-4a44-ba96-5dc77248d5e5 tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] Calling method '>' {{(pid=61306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 04:09:58 user devstack@n-api.service[61306]: DEBUG nova.compute.api [None req-94f073b6-24e2-4a44-ba96-5dc77248d5e5 tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] [instance: b04c49a4-646d-43aa-96ea-d835bf673e42] Fetching instance by UUID {{(pid=61306) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 23 04:09:58 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-94f073b6-24e2-4a44-ba96-5dc77248d5e5 tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 04:09:58 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-94f073b6-24e2-4a44-ba96-5dc77248d5e5 tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 04:09:58 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-94f073b6-24e2-4a44-ba96-5dc77248d5e5 tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 04:09:58 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-94f073b6-24e2-4a44-ba96-5dc77248d5e5 tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 04:09:58 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-94f073b6-24e2-4a44-ba96-5dc77248d5e5 tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 04:09:58 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-94f073b6-24e2-4a44-ba96-5dc77248d5e5 tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 04:09:58 user devstack@n-api.service[61306]: DEBUG nova.compute.api [None req-94f073b6-24e2-4a44-ba96-5dc77248d5e5 tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] [instance: b04c49a4-646d-43aa-96ea-d835bf673e42] Going to try to terminate instance {{(pid=61306) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 23 04:09:58 user devstack@n-api.service[61306]: INFO nova.api.openstack.requestlog [None req-94f073b6-24e2-4a44-ba96-5dc77248d5e5 tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b04c49a4-646d-43aa-96ea-d835bf673e42" status: 204 len: 0 microversion: 2.20 time: 0.113286 Apr 23 04:09:58 user devstack@n-api.service[61306]: [pid: 61306|app: 0|req: 149/450] 10.0.0.210 () {64 vars in 1357 bytes} [Sun Apr 23 04:09:57 2023] DELETE /compute/v2.1/servers/b04c49a4-646d-43aa-96ea-d835bf673e42 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 23 04:09:58 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi [None req-e89ba1b9-d2cf-4426-8f1f-d46f9334a16a tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] Calling method '>' {{(pid=61308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 04:09:58 user devstack@n-api.service[61308]: DEBUG nova.compute.api [None req-e89ba1b9-d2cf-4426-8f1f-d46f9334a16a tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] [instance: b04c49a4-646d-43aa-96ea-d835bf673e42] Fetching instance by UUID {{(pid=61308) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 23 04:09:58 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-e89ba1b9-d2cf-4426-8f1f-d46f9334a16a tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 04:09:58 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-e89ba1b9-d2cf-4426-8f1f-d46f9334a16a tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 04:09:58 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-e89ba1b9-d2cf-4426-8f1f-d46f9334a16a tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 04:09:58 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-e89ba1b9-d2cf-4426-8f1f-d46f9334a16a tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 04:09:58 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-e89ba1b9-d2cf-4426-8f1f-d46f9334a16a tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 04:09:58 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-e89ba1b9-d2cf-4426-8f1f-d46f9334a16a tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 04:09:58 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi [req-02d7b007-578c-4582-9e63-90092ad25bff req-ecfa2430-3e9f-4b6a-bf86-0293ae90dcf0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b04c49a4-646d-43aa-96ea-d835bf673e42", "name": "network-vif-unplugged", "status": "completed", "tag": "1b9a901a-8358-4b1c-89a7-de0772c2697e"}, {"server_uuid": "b04c49a4-646d-43aa-96ea-d835bf673e42", "name": "network-vif-plugged", "status": "completed", "tag": "1b9a901a-8358-4b1c-89a7-de0772c2697e"}]} {{(pid=61307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 04:09:58 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [req-02d7b007-578c-4582-9e63-90092ad25bff req-ecfa2430-3e9f-4b6a-bf86-0293ae90dcf0 service nova] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 04:09:58 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [req-02d7b007-578c-4582-9e63-90092ad25bff req-ecfa2430-3e9f-4b6a-bf86-0293ae90dcf0 service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 04:09:58 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [req-02d7b007-578c-4582-9e63-90092ad25bff req-ecfa2430-3e9f-4b6a-bf86-0293ae90dcf0 service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 04:09:58 user devstack@n-api.service[61307]: INFO nova.api.openstack.compute.server_external_events [req-02d7b007-578c-4582-9e63-90092ad25bff req-ecfa2430-3e9f-4b6a-bf86-0293ae90dcf0 service nova] Creating event network-vif-unplugged:1b9a901a-8358-4b1c-89a7-de0772c2697e for instance b04c49a4-646d-43aa-96ea-d835bf673e42 on user Apr 23 04:09:58 user devstack@n-api.service[61307]: INFO nova.api.openstack.compute.server_external_events [req-02d7b007-578c-4582-9e63-90092ad25bff req-ecfa2430-3e9f-4b6a-bf86-0293ae90dcf0 service nova] Creating event network-vif-plugged:1b9a901a-8358-4b1c-89a7-de0772c2697e for instance b04c49a4-646d-43aa-96ea-d835bf673e42 on user Apr 23 04:09:58 user devstack@n-api.service[61307]: INFO nova.api.openstack.requestlog [req-02d7b007-578c-4582-9e63-90092ad25bff req-ecfa2430-3e9f-4b6a-bf86-0293ae90dcf0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.035161 Apr 23 04:09:58 user devstack@n-api.service[61307]: [pid: 61307|app: 0|req: 151/451] 10.0.0.210 () {68 vars in 1394 bytes} [Sun Apr 23 04:09:58 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 23 04:09:58 user devstack@n-api.service[61308]: DEBUG nova.policy [None req-e89ba1b9-d2cf-4426-8f1f-d46f9334a16a tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929f88dec4234641a37fdda799108cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d84d2e6776c4ac38b90b752a36600c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61308) authorize /opt/stack/nova/nova/policy.py:203}} Apr 23 04:09:58 user devstack@n-api.service[61308]: DEBUG nova.policy [None req-e89ba1b9-d2cf-4426-8f1f-d46f9334a16a tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '929f88dec4234641a37fdda799108cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d84d2e6776c4ac38b90b752a36600c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61308) authorize /opt/stack/nova/nova/policy.py:203}} Apr 23 04:09:58 user devstack@n-api.service[61308]: DEBUG nova.policy [None req-e89ba1b9-d2cf-4426-8f1f-d46f9334a16a tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '929f88dec4234641a37fdda799108cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d84d2e6776c4ac38b90b752a36600c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61308) authorize /opt/stack/nova/nova/policy.py:203}} Apr 23 04:09:58 user devstack@n-api.service[61308]: INFO nova.api.openstack.requestlog [None req-e89ba1b9-d2cf-4426-8f1f-d46f9334a16a tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b04c49a4-646d-43aa-96ea-d835bf673e42" status: 200 len: 1712 microversion: 2.20 time: 0.594633 Apr 23 04:09:58 user devstack@n-api.service[61308]: [pid: 61308|app: 0|req: 152/452] 10.0.0.210 () {64 vars in 1354 bytes} [Sun Apr 23 04:09:58 2023] GET /compute/v2.1/servers/b04c49a4-646d-43aa-96ea-d835bf673e42 => generated 1712 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 23 04:10:00 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi [req-4a9f10d9-7b61-4056-a308-2fe3454360c5 req-d2eeec65-96dd-497e-b95a-6a2239348a22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b04c49a4-646d-43aa-96ea-d835bf673e42", "name": "network-vif-deleted", "tag": "1b9a901a-8358-4b1c-89a7-de0772c2697e"}]} {{(pid=61306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 23 04:10:00 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [req-4a9f10d9-7b61-4056-a308-2fe3454360c5 req-d2eeec65-96dd-497e-b95a-6a2239348a22 service nova] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 04:10:00 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [req-4a9f10d9-7b61-4056-a308-2fe3454360c5 req-d2eeec65-96dd-497e-b95a-6a2239348a22 service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 04:10:00 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [req-4a9f10d9-7b61-4056-a308-2fe3454360c5 req-d2eeec65-96dd-497e-b95a-6a2239348a22 service nova] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 04:10:00 user devstack@n-api.service[61306]: INFO nova.api.openstack.compute.server_external_events [req-4a9f10d9-7b61-4056-a308-2fe3454360c5 req-d2eeec65-96dd-497e-b95a-6a2239348a22 service nova] Creating event network-vif-deleted:1b9a901a-8358-4b1c-89a7-de0772c2697e for instance b04c49a4-646d-43aa-96ea-d835bf673e42 on user Apr 23 04:10:00 user devstack@n-api.service[61306]: INFO nova.api.openstack.requestlog [req-4a9f10d9-7b61-4056-a308-2fe3454360c5 req-d2eeec65-96dd-497e-b95a-6a2239348a22 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104481 Apr 23 04:10:00 user devstack@n-api.service[61306]: [pid: 61306|app: 0|req: 150/453] 10.0.0.210 () {68 vars in 1394 bytes} [Sun Apr 23 04:09:59 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 23 04:10:48 user devstack@n-api.service[61307]: DEBUG dbcounter [-] [61307] Writing DB stats nova_api:SELECT=4 {{(pid=61307) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 04:10:48 user devstack@n-api.service[61307]: DEBUG dbcounter [-] [61307] Writing DB stats nova_cell1:SELECT=6 {{(pid=61307) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 04:10:48 user devstack@n-api.service[61307]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 23 04:10:48 user devstack@n-api.service[61307]: Sun Apr 23 04:10:48 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b04c49a4-646d-43aa-96ea-d835bf673e42 (ip 10.0.0.210) !!! Apr 23 04:10:48 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi [None req-f6a5af71-a2ea-4f25-9924-bab120bbd28e tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] Calling method '>' {{(pid=61307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 04:10:48 user devstack@n-api.service[61307]: DEBUG nova.compute.api [None req-f6a5af71-a2ea-4f25-9924-bab120bbd28e tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] [instance: b04c49a4-646d-43aa-96ea-d835bf673e42] Fetching instance by UUID {{(pid=61307) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 23 04:10:48 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-f6a5af71-a2ea-4f25-9924-bab120bbd28e tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 04:10:48 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-f6a5af71-a2ea-4f25-9924-bab120bbd28e tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 04:10:48 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-f6a5af71-a2ea-4f25-9924-bab120bbd28e tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 04:10:48 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-f6a5af71-a2ea-4f25-9924-bab120bbd28e tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 04:10:48 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-f6a5af71-a2ea-4f25-9924-bab120bbd28e tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 04:10:48 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-f6a5af71-a2ea-4f25-9924-bab120bbd28e tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 04:10:48 user devstack@n-api.service[61307]: INFO nova.api.openstack.wsgi [None req-f6a5af71-a2ea-4f25-9924-bab120bbd28e tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] HTTP exception thrown: Instance b04c49a4-646d-43aa-96ea-d835bf673e42 could not be found. Apr 23 04:10:48 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi [None req-f6a5af71-a2ea-4f25-9924-bab120bbd28e tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] Request method failure captured: Apr 23 04:10:48 user devstack@n-api.service[61307]: request: GET /compute/v2.1/servers/b04c49a4-646d-43aa-96ea-d835bf673e42 HTTP/1.1 Apr 23 04:10:48 user devstack@n-api.service[61307]: Accept: application/json Apr 23 04:10:48 user devstack@n-api.service[61307]: Accept-Encoding: identity Apr 23 04:10:48 user devstack@n-api.service[61307]: Connection: close Apr 23 04:10:48 user devstack@n-api.service[61307]: Content-Length: 0 Apr 23 04:10:48 user devstack@n-api.service[61307]: Content-Type: application/json Apr 23 04:10:48 user devstack@n-api.service[61307]: Host: 10.0.0.210 Apr 23 04:10:48 user devstack@n-api.service[61307]: Openstack-System-Scope: None Apr 23 04:10:48 user devstack@n-api.service[61307]: User-Agent: python-urllib3/1.26.15 Apr 23 04:10:48 user devstack@n-api.service[61307]: X-Auth-Token: gAAAAABkRK57iHgBWhBr7oDpNVFk09r9LkBMLJJvLUDSAB35CE4DR6LQUcoSG_MgoXOReh7P7cRjjTvhSXqG3zBWun0b0IiY3L6kl45ZnSEItShYRvU-Vju8srqNOxIHR6NgMoApmgrMt7TjIq1s8-6piWDQTSwCsUa-UWl-mg7ZtxilZiL_w1U Apr 23 04:10:48 user devstack@n-api.service[61307]: X-Domain-Id: None Apr 23 04:10:48 user devstack@n-api.service[61307]: X-Domain-Name: None Apr 23 04:10:48 user devstack@n-api.service[61307]: X-Identity-Status: Confirmed Apr 23 04:10:48 user devstack@n-api.service[61307]: X-Is-Admin-Project: True Apr 23 04:10:48 user devstack@n-api.service[61307]: X-Openstack-Nova-Api-Version: 2.20 Apr 23 04:10:48 user devstack@n-api.service[61307]: X-Project-Domain-Id: default Apr 23 04:10:48 user devstack@n-api.service[61307]: X-Project-Domain-Name: Default Apr 23 04:10:48 user devstack@n-api.service[61307]: X-Project-Id: 7d84d2e6776c4ac38b90b752a36600c3 Apr 23 04:10:48 user devstack@n-api.service[61307]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1622749322 Apr 23 04:10:48 user devstack@n-api.service[61307]: X-Role: reader,member Apr 23 04:10:48 user devstack@n-api.service[61307]: X-Roles: reader,member Apr 23 04:10:48 user devstack@n-api.service[61307]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7d84d2e6776c4ac38b90b752a36600c3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7d84d2e6776c4ac38b90b752a36600c3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/7d84d2e6776c4ac38b90b752a36600c3"}]}] Apr 23 04:10:48 user devstack@n-api.service[61307]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1622749322 Apr 23 04:10:48 user devstack@n-api.service[61307]: X-Tenant-Id: 7d84d2e6776c4ac38b90b752a36600c3 Apr 23 04:10:48 user devstack@n-api.service[61307]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1622749322 Apr 23 04:10:48 user devstack@n-api.service[61307]: X-User: tempest-AttachVolumeShelveTestJSON-1622749322-project-member Apr 23 04:10:48 user devstack@n-api.service[61307]: X-User-Domain-Id: default Apr 23 04:10:48 user devstack@n-api.service[61307]: X-User-Domain-Name: Default Apr 23 04:10:48 user devstack@n-api.service[61307]: X-User-Id: 929f88dec4234641a37fdda799108cf2 Apr 23 04:10:48 user devstack@n-api.service[61307]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1622749322-project-member Apr 23 04:10:48 user devstack@n-api.service[61307]: method: > Apr 23 04:10:48 user devstack@n-api.service[61307]: exception: Instance b04c49a4-646d-43aa-96ea-d835bf673e42 could not be found. Apr 23 04:10:48 user devstack@n-api.service[61307]: action_args: {'id': 'b04c49a4-646d-43aa-96ea-d835bf673e42'} Apr 23 04:10:48 user devstack@n-api.service[61307]: {{(pid=61307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 23 04:10:48 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 23 04:10:48 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 23 04:10:48 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 23 04:10:48 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 23 04:10:48 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 23 04:10:48 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 23 04:10:48 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 23 04:10:48 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 23 04:10:48 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 23 04:10:48 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b04c49a4-646d-43aa-96ea-d835bf673e42 could not be found. Apr 23 04:10:48 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi Apr 23 04:10:48 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 23 04:10:48 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi Apr 23 04:10:48 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 23 04:10:48 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 23 04:10:48 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 23 04:10:48 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 23 04:10:48 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 23 04:10:48 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 23 04:10:48 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 23 04:10:48 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 23 04:10:48 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 23 04:10:48 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 23 04:10:48 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 23 04:10:48 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 23 04:10:48 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 23 04:10:48 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b04c49a4-646d-43aa-96ea-d835bf673e42 could not be found. Apr 23 04:10:48 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi Apr 23 04:10:48 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 23 04:10:48 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi Apr 23 04:10:48 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 23 04:10:48 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 23 04:10:48 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 23 04:10:48 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 23 04:10:48 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 23 04:10:48 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b04c49a4-646d-43aa-96ea-d835bf673e42 could not be found. Apr 23 04:10:48 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi Apr 23 04:10:48 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi [None req-f6a5af71-a2ea-4f25-9924-bab120bbd28e tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] Returning 404 to user: Instance b04c49a4-646d-43aa-96ea-d835bf673e42 could not be found. {{(pid=61307) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 23 04:10:48 user devstack@n-api.service[61307]: INFO nova.api.openstack.requestlog [None req-f6a5af71-a2ea-4f25-9924-bab120bbd28e tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b04c49a4-646d-43aa-96ea-d835bf673e42" status: 404 len: 111 microversion: 2.20 time: 0.136174 Apr 23 04:10:48 user devstack@n-api.service[61307]: [pid: 61307|app: 0|req: 152/454] 10.0.0.210 () {64 vars in 1354 bytes} [Sun Apr 23 04:10:48 2023] GET /compute/v2.1/servers/b04c49a4-646d-43aa-96ea-d835bf673e42 => generated 111 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 23 04:10:48 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi [None req-efa9aeb6-79f5-4d77-9abd-8a40e0498cff tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] Calling method '.version_select at 0x7f21e10d6dd0>' {{(pid=61308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 04:10:48 user devstack@n-api.service[61308]: ERROR oslo.messaging._drivers.impl_rabbit [None req-efa9aeb6-79f5-4d77-9abd-8a40e0498cff tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] [ed2e77e3-639d-42a7-ba72-c7ae196501ac] AMQP server on 10.0.0.210:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 23 04:10:48 user devstack@n-api.service[61308]: DEBUG dbcounter [-] [61308] Writing DB stats nova_api:SELECT=4 {{(pid=61308) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 04:10:48 user devstack@n-api.service[61308]: DEBUG dbcounter [-] [61308] Writing DB stats nova_cell1:SELECT=8 {{(pid=61308) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 04:10:49 user devstack@n-api.service[61308]: INFO oslo.messaging._drivers.impl_rabbit [None req-efa9aeb6-79f5-4d77-9abd-8a40e0498cff tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] [ed2e77e3-639d-42a7-ba72-c7ae196501ac] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 47484. Apr 23 04:10:49 user devstack@n-api.service[61308]: INFO nova.api.openstack.requestlog [None req-efa9aeb6-79f5-4d77-9abd-8a40e0498cff tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-911657479" status: 204 len: 0 microversion: 2.20 time: 1.037909 Apr 23 04:10:49 user devstack@n-api.service[61308]: [pid: 61308|app: 0|req: 153/455] 10.0.0.210 () {64 vars in 1336 bytes} [Sun Apr 23 04:10:48 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-911657479 => generated 0 bytes in 1039 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 23 04:10:51 user devstack@n-api.service[61306]: DEBUG dbcounter [-] [61306] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=61306) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 04:10:51 user devstack@n-api.service[61306]: DEBUG dbcounter [-] [61306] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61306) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 23 04:10:51 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi [None req-653a4d1e-71dc-4596-8264-1fd7806817d7 tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] Calling method '>' {{(pid=61306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 04:10:51 user devstack@n-api.service[61306]: DEBUG nova.compute.api [None req-653a4d1e-71dc-4596-8264-1fd7806817d7 tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] [instance: b04c49a4-646d-43aa-96ea-d835bf673e42] Fetching instance by UUID {{(pid=61306) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 23 04:10:51 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-653a4d1e-71dc-4596-8264-1fd7806817d7 tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 04:10:51 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-653a4d1e-71dc-4596-8264-1fd7806817d7 tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 04:10:51 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-653a4d1e-71dc-4596-8264-1fd7806817d7 tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 04:10:51 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-653a4d1e-71dc-4596-8264-1fd7806817d7 tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 04:10:51 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-653a4d1e-71dc-4596-8264-1fd7806817d7 tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 04:10:51 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-653a4d1e-71dc-4596-8264-1fd7806817d7 tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 04:10:51 user devstack@n-api.service[61306]: INFO nova.api.openstack.wsgi [None req-653a4d1e-71dc-4596-8264-1fd7806817d7 tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] HTTP exception thrown: Instance b04c49a4-646d-43aa-96ea-d835bf673e42 could not be found. Apr 23 04:10:51 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi [None req-653a4d1e-71dc-4596-8264-1fd7806817d7 tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] Request method failure captured: Apr 23 04:10:51 user devstack@n-api.service[61306]: request: DELETE /compute/v2.1/servers/b04c49a4-646d-43aa-96ea-d835bf673e42 HTTP/1.1 Apr 23 04:10:51 user devstack@n-api.service[61306]: Accept: application/json Apr 23 04:10:51 user devstack@n-api.service[61306]: Accept-Encoding: identity Apr 23 04:10:51 user devstack@n-api.service[61306]: Connection: close Apr 23 04:10:51 user devstack@n-api.service[61306]: Content-Length: 0 Apr 23 04:10:51 user devstack@n-api.service[61306]: Content-Type: application/json Apr 23 04:10:51 user devstack@n-api.service[61306]: Host: 10.0.0.210 Apr 23 04:10:51 user devstack@n-api.service[61306]: Openstack-System-Scope: None Apr 23 04:10:51 user devstack@n-api.service[61306]: User-Agent: python-urllib3/1.26.15 Apr 23 04:10:51 user devstack@n-api.service[61306]: X-Auth-Token: gAAAAABkRK57iHgBWhBr7oDpNVFk09r9LkBMLJJvLUDSAB35CE4DR6LQUcoSG_MgoXOReh7P7cRjjTvhSXqG3zBWun0b0IiY3L6kl45ZnSEItShYRvU-Vju8srqNOxIHR6NgMoApmgrMt7TjIq1s8-6piWDQTSwCsUa-UWl-mg7ZtxilZiL_w1U Apr 23 04:10:51 user devstack@n-api.service[61306]: X-Domain-Id: None Apr 23 04:10:51 user devstack@n-api.service[61306]: X-Domain-Name: None Apr 23 04:10:51 user devstack@n-api.service[61306]: X-Identity-Status: Confirmed Apr 23 04:10:51 user devstack@n-api.service[61306]: X-Is-Admin-Project: True Apr 23 04:10:51 user devstack@n-api.service[61306]: X-Openstack-Nova-Api-Version: 2.20 Apr 23 04:10:51 user devstack@n-api.service[61306]: X-Project-Domain-Id: default Apr 23 04:10:51 user devstack@n-api.service[61306]: X-Project-Domain-Name: Default Apr 23 04:10:51 user devstack@n-api.service[61306]: X-Project-Id: 7d84d2e6776c4ac38b90b752a36600c3 Apr 23 04:10:51 user devstack@n-api.service[61306]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1622749322 Apr 23 04:10:51 user devstack@n-api.service[61306]: X-Role: reader,member Apr 23 04:10:51 user devstack@n-api.service[61306]: X-Roles: reader,member Apr 23 04:10:51 user devstack@n-api.service[61306]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7d84d2e6776c4ac38b90b752a36600c3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7d84d2e6776c4ac38b90b752a36600c3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/7d84d2e6776c4ac38b90b752a36600c3"}]}] Apr 23 04:10:51 user devstack@n-api.service[61306]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1622749322 Apr 23 04:10:51 user devstack@n-api.service[61306]: X-Tenant-Id: 7d84d2e6776c4ac38b90b752a36600c3 Apr 23 04:10:51 user devstack@n-api.service[61306]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1622749322 Apr 23 04:10:51 user devstack@n-api.service[61306]: X-User: tempest-AttachVolumeShelveTestJSON-1622749322-project-member Apr 23 04:10:51 user devstack@n-api.service[61306]: X-User-Domain-Id: default Apr 23 04:10:51 user devstack@n-api.service[61306]: X-User-Domain-Name: Default Apr 23 04:10:51 user devstack@n-api.service[61306]: X-User-Id: 929f88dec4234641a37fdda799108cf2 Apr 23 04:10:51 user devstack@n-api.service[61306]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1622749322-project-member Apr 23 04:10:51 user devstack@n-api.service[61306]: method: > Apr 23 04:10:51 user devstack@n-api.service[61306]: exception: Instance b04c49a4-646d-43aa-96ea-d835bf673e42 could not be found. Apr 23 04:10:51 user devstack@n-api.service[61306]: action_args: {'id': 'b04c49a4-646d-43aa-96ea-d835bf673e42'} Apr 23 04:10:51 user devstack@n-api.service[61306]: {{(pid=61306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 23 04:10:51 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 23 04:10:51 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 23 04:10:51 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 23 04:10:51 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 23 04:10:51 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 23 04:10:51 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 23 04:10:51 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 23 04:10:51 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 23 04:10:51 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 23 04:10:51 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b04c49a4-646d-43aa-96ea-d835bf673e42 could not be found. Apr 23 04:10:51 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi Apr 23 04:10:51 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 23 04:10:51 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi Apr 23 04:10:51 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 23 04:10:51 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 23 04:10:51 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 23 04:10:51 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 23 04:10:51 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 23 04:10:51 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 23 04:10:51 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 23 04:10:51 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 23 04:10:51 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 23 04:10:51 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 23 04:10:51 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 23 04:10:51 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 23 04:10:51 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 23 04:10:51 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 23 04:10:51 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 23 04:10:51 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b04c49a4-646d-43aa-96ea-d835bf673e42 could not be found. Apr 23 04:10:51 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi Apr 23 04:10:51 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 23 04:10:51 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi Apr 23 04:10:51 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 23 04:10:51 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 23 04:10:51 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 23 04:10:51 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 23 04:10:51 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 23 04:10:51 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b04c49a4-646d-43aa-96ea-d835bf673e42 could not be found. Apr 23 04:10:51 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi Apr 23 04:10:51 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi [None req-653a4d1e-71dc-4596-8264-1fd7806817d7 tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] Returning 404 to user: Instance b04c49a4-646d-43aa-96ea-d835bf673e42 could not be found. {{(pid=61306) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 23 04:10:51 user devstack@n-api.service[61306]: INFO nova.api.openstack.requestlog [None req-653a4d1e-71dc-4596-8264-1fd7806817d7 tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b04c49a4-646d-43aa-96ea-d835bf673e42" status: 404 len: 111 microversion: 2.20 time: 0.035958 Apr 23 04:10:51 user devstack@n-api.service[61306]: [pid: 61306|app: 0|req: 151/456] 10.0.0.210 () {64 vars in 1357 bytes} [Sun Apr 23 04:10:51 2023] DELETE /compute/v2.1/servers/b04c49a4-646d-43aa-96ea-d835bf673e42 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Apr 23 04:10:51 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi [None req-14597c21-c09b-4768-8136-00d1d38e831f tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] Calling method '>' {{(pid=61307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 04:10:51 user devstack@n-api.service[61307]: DEBUG nova.compute.api [None req-14597c21-c09b-4768-8136-00d1d38e831f tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] [instance: b04c49a4-646d-43aa-96ea-d835bf673e42] Fetching instance by UUID {{(pid=61307) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 23 04:10:51 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-14597c21-c09b-4768-8136-00d1d38e831f tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 04:10:51 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-14597c21-c09b-4768-8136-00d1d38e831f tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 04:10:51 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-14597c21-c09b-4768-8136-00d1d38e831f tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 04:10:51 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-14597c21-c09b-4768-8136-00d1d38e831f tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 04:10:51 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-14597c21-c09b-4768-8136-00d1d38e831f tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 04:10:51 user devstack@n-api.service[61307]: DEBUG oslo_concurrency.lockutils [None req-14597c21-c09b-4768-8136-00d1d38e831f tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61307) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 04:10:51 user devstack@n-api.service[61307]: INFO nova.api.openstack.wsgi [None req-14597c21-c09b-4768-8136-00d1d38e831f tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] HTTP exception thrown: Instance b04c49a4-646d-43aa-96ea-d835bf673e42 could not be found. Apr 23 04:10:51 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi [None req-14597c21-c09b-4768-8136-00d1d38e831f tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] Request method failure captured: Apr 23 04:10:51 user devstack@n-api.service[61307]: request: GET /compute/v2.1/servers/b04c49a4-646d-43aa-96ea-d835bf673e42 HTTP/1.1 Apr 23 04:10:51 user devstack@n-api.service[61307]: Accept: application/json Apr 23 04:10:51 user devstack@n-api.service[61307]: Accept-Encoding: identity Apr 23 04:10:51 user devstack@n-api.service[61307]: Connection: close Apr 23 04:10:51 user devstack@n-api.service[61307]: Content-Length: 0 Apr 23 04:10:51 user devstack@n-api.service[61307]: Content-Type: application/json Apr 23 04:10:51 user devstack@n-api.service[61307]: Host: 10.0.0.210 Apr 23 04:10:51 user devstack@n-api.service[61307]: Openstack-System-Scope: None Apr 23 04:10:51 user devstack@n-api.service[61307]: User-Agent: python-urllib3/1.26.15 Apr 23 04:10:51 user devstack@n-api.service[61307]: X-Auth-Token: gAAAAABkRK57iHgBWhBr7oDpNVFk09r9LkBMLJJvLUDSAB35CE4DR6LQUcoSG_MgoXOReh7P7cRjjTvhSXqG3zBWun0b0IiY3L6kl45ZnSEItShYRvU-Vju8srqNOxIHR6NgMoApmgrMt7TjIq1s8-6piWDQTSwCsUa-UWl-mg7ZtxilZiL_w1U Apr 23 04:10:51 user devstack@n-api.service[61307]: X-Domain-Id: None Apr 23 04:10:51 user devstack@n-api.service[61307]: X-Domain-Name: None Apr 23 04:10:51 user devstack@n-api.service[61307]: X-Identity-Status: Confirmed Apr 23 04:10:51 user devstack@n-api.service[61307]: X-Is-Admin-Project: True Apr 23 04:10:51 user devstack@n-api.service[61307]: X-Openstack-Nova-Api-Version: 2.20 Apr 23 04:10:51 user devstack@n-api.service[61307]: X-Project-Domain-Id: default Apr 23 04:10:51 user devstack@n-api.service[61307]: X-Project-Domain-Name: Default Apr 23 04:10:51 user devstack@n-api.service[61307]: X-Project-Id: 7d84d2e6776c4ac38b90b752a36600c3 Apr 23 04:10:51 user devstack@n-api.service[61307]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1622749322 Apr 23 04:10:51 user devstack@n-api.service[61307]: X-Role: reader,member Apr 23 04:10:51 user devstack@n-api.service[61307]: X-Roles: reader,member Apr 23 04:10:51 user devstack@n-api.service[61307]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7d84d2e6776c4ac38b90b752a36600c3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7d84d2e6776c4ac38b90b752a36600c3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/7d84d2e6776c4ac38b90b752a36600c3"}]}] Apr 23 04:10:51 user devstack@n-api.service[61307]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1622749322 Apr 23 04:10:51 user devstack@n-api.service[61307]: X-Tenant-Id: 7d84d2e6776c4ac38b90b752a36600c3 Apr 23 04:10:51 user devstack@n-api.service[61307]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1622749322 Apr 23 04:10:51 user devstack@n-api.service[61307]: X-User: tempest-AttachVolumeShelveTestJSON-1622749322-project-member Apr 23 04:10:51 user devstack@n-api.service[61307]: X-User-Domain-Id: default Apr 23 04:10:51 user devstack@n-api.service[61307]: X-User-Domain-Name: Default Apr 23 04:10:51 user devstack@n-api.service[61307]: X-User-Id: 929f88dec4234641a37fdda799108cf2 Apr 23 04:10:51 user devstack@n-api.service[61307]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1622749322-project-member Apr 23 04:10:51 user devstack@n-api.service[61307]: method: > Apr 23 04:10:51 user devstack@n-api.service[61307]: exception: Instance b04c49a4-646d-43aa-96ea-d835bf673e42 could not be found. Apr 23 04:10:51 user devstack@n-api.service[61307]: action_args: {'id': 'b04c49a4-646d-43aa-96ea-d835bf673e42'} Apr 23 04:10:51 user devstack@n-api.service[61307]: {{(pid=61307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 23 04:10:51 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 23 04:10:51 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 23 04:10:51 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 23 04:10:51 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 23 04:10:51 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 23 04:10:51 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 23 04:10:51 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 23 04:10:51 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 23 04:10:51 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 23 04:10:51 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b04c49a4-646d-43aa-96ea-d835bf673e42 could not be found. Apr 23 04:10:51 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi Apr 23 04:10:51 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 23 04:10:51 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi Apr 23 04:10:51 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 23 04:10:51 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 23 04:10:51 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 23 04:10:51 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 23 04:10:51 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 23 04:10:51 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 23 04:10:51 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 23 04:10:51 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 23 04:10:51 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 23 04:10:51 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 23 04:10:51 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 23 04:10:51 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 23 04:10:51 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 23 04:10:51 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b04c49a4-646d-43aa-96ea-d835bf673e42 could not be found. Apr 23 04:10:51 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi Apr 23 04:10:51 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 23 04:10:51 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi Apr 23 04:10:51 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 23 04:10:51 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 23 04:10:51 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 23 04:10:51 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 23 04:10:51 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 23 04:10:51 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b04c49a4-646d-43aa-96ea-d835bf673e42 could not be found. Apr 23 04:10:51 user devstack@n-api.service[61307]: ERROR nova.api.openstack.wsgi Apr 23 04:10:51 user devstack@n-api.service[61307]: DEBUG nova.api.openstack.wsgi [None req-14597c21-c09b-4768-8136-00d1d38e831f tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] Returning 404 to user: Instance b04c49a4-646d-43aa-96ea-d835bf673e42 could not be found. {{(pid=61307) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 23 04:10:51 user devstack@n-api.service[61307]: INFO nova.api.openstack.requestlog [None req-14597c21-c09b-4768-8136-00d1d38e831f tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b04c49a4-646d-43aa-96ea-d835bf673e42" status: 404 len: 111 microversion: 2.20 time: 0.027231 Apr 23 04:10:51 user devstack@n-api.service[61307]: [pid: 61307|app: 0|req: 153/457] 10.0.0.210 () {64 vars in 1354 bytes} [Sun Apr 23 04:10:51 2023] GET /compute/v2.1/servers/b04c49a4-646d-43aa-96ea-d835bf673e42 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 23 04:10:51 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi [None req-825c6d8f-85a4-4c59-880f-d9b2fffc41a4 tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] Calling method '>' {{(pid=61308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 04:10:51 user devstack@n-api.service[61308]: DEBUG nova.compute.api [None req-825c6d8f-85a4-4c59-880f-d9b2fffc41a4 tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] [instance: 4205fb36-0df5-4c11-b468-89f59d97352c] Fetching instance by UUID {{(pid=61308) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 23 04:10:51 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-825c6d8f-85a4-4c59-880f-d9b2fffc41a4 tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 04:10:51 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-825c6d8f-85a4-4c59-880f-d9b2fffc41a4 tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 04:10:51 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-825c6d8f-85a4-4c59-880f-d9b2fffc41a4 tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 04:10:51 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-825c6d8f-85a4-4c59-880f-d9b2fffc41a4 tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 04:10:51 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-825c6d8f-85a4-4c59-880f-d9b2fffc41a4 tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 04:10:51 user devstack@n-api.service[61308]: DEBUG oslo_concurrency.lockutils [None req-825c6d8f-85a4-4c59-880f-d9b2fffc41a4 tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 04:10:51 user devstack@n-api.service[61308]: INFO nova.api.openstack.wsgi [None req-825c6d8f-85a4-4c59-880f-d9b2fffc41a4 tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] HTTP exception thrown: Instance 4205fb36-0df5-4c11-b468-89f59d97352c could not be found. Apr 23 04:10:51 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi [None req-825c6d8f-85a4-4c59-880f-d9b2fffc41a4 tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] Request method failure captured: Apr 23 04:10:51 user devstack@n-api.service[61308]: request: DELETE /compute/v2.1/servers/4205fb36-0df5-4c11-b468-89f59d97352c HTTP/1.1 Apr 23 04:10:51 user devstack@n-api.service[61308]: Accept: application/json Apr 23 04:10:51 user devstack@n-api.service[61308]: Accept-Encoding: identity Apr 23 04:10:51 user devstack@n-api.service[61308]: Connection: close Apr 23 04:10:51 user devstack@n-api.service[61308]: Content-Length: 0 Apr 23 04:10:51 user devstack@n-api.service[61308]: Content-Type: application/json Apr 23 04:10:51 user devstack@n-api.service[61308]: Host: 10.0.0.210 Apr 23 04:10:51 user devstack@n-api.service[61308]: Openstack-System-Scope: None Apr 23 04:10:51 user devstack@n-api.service[61308]: User-Agent: python-urllib3/1.26.15 Apr 23 04:10:51 user devstack@n-api.service[61308]: X-Auth-Token: gAAAAABkRK57iHgBWhBr7oDpNVFk09r9LkBMLJJvLUDSAB35CE4DR6LQUcoSG_MgoXOReh7P7cRjjTvhSXqG3zBWun0b0IiY3L6kl45ZnSEItShYRvU-Vju8srqNOxIHR6NgMoApmgrMt7TjIq1s8-6piWDQTSwCsUa-UWl-mg7ZtxilZiL_w1U Apr 23 04:10:51 user devstack@n-api.service[61308]: X-Domain-Id: None Apr 23 04:10:51 user devstack@n-api.service[61308]: X-Domain-Name: None Apr 23 04:10:51 user devstack@n-api.service[61308]: X-Identity-Status: Confirmed Apr 23 04:10:51 user devstack@n-api.service[61308]: X-Is-Admin-Project: True Apr 23 04:10:51 user devstack@n-api.service[61308]: X-Openstack-Nova-Api-Version: 2.20 Apr 23 04:10:51 user devstack@n-api.service[61308]: X-Project-Domain-Id: default Apr 23 04:10:51 user devstack@n-api.service[61308]: X-Project-Domain-Name: Default Apr 23 04:10:51 user devstack@n-api.service[61308]: X-Project-Id: 7d84d2e6776c4ac38b90b752a36600c3 Apr 23 04:10:51 user devstack@n-api.service[61308]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1622749322 Apr 23 04:10:51 user devstack@n-api.service[61308]: X-Role: reader,member Apr 23 04:10:51 user devstack@n-api.service[61308]: X-Roles: reader,member Apr 23 04:10:51 user devstack@n-api.service[61308]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7d84d2e6776c4ac38b90b752a36600c3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7d84d2e6776c4ac38b90b752a36600c3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/7d84d2e6776c4ac38b90b752a36600c3"}]}] Apr 23 04:10:51 user devstack@n-api.service[61308]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1622749322 Apr 23 04:10:51 user devstack@n-api.service[61308]: X-Tenant-Id: 7d84d2e6776c4ac38b90b752a36600c3 Apr 23 04:10:51 user devstack@n-api.service[61308]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1622749322 Apr 23 04:10:51 user devstack@n-api.service[61308]: X-User: tempest-AttachVolumeShelveTestJSON-1622749322-project-member Apr 23 04:10:51 user devstack@n-api.service[61308]: X-User-Domain-Id: default Apr 23 04:10:51 user devstack@n-api.service[61308]: X-User-Domain-Name: Default Apr 23 04:10:51 user devstack@n-api.service[61308]: X-User-Id: 929f88dec4234641a37fdda799108cf2 Apr 23 04:10:51 user devstack@n-api.service[61308]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1622749322-project-member Apr 23 04:10:51 user devstack@n-api.service[61308]: method: > Apr 23 04:10:51 user devstack@n-api.service[61308]: exception: Instance 4205fb36-0df5-4c11-b468-89f59d97352c could not be found. Apr 23 04:10:51 user devstack@n-api.service[61308]: action_args: {'id': '4205fb36-0df5-4c11-b468-89f59d97352c'} Apr 23 04:10:51 user devstack@n-api.service[61308]: {{(pid=61308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 23 04:10:51 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 23 04:10:51 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 23 04:10:51 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 23 04:10:51 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 23 04:10:51 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 23 04:10:51 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 23 04:10:51 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 23 04:10:51 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 23 04:10:51 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 23 04:10:51 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4205fb36-0df5-4c11-b468-89f59d97352c could not be found. Apr 23 04:10:51 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi Apr 23 04:10:51 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 23 04:10:51 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi Apr 23 04:10:51 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 23 04:10:51 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 23 04:10:51 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 23 04:10:51 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 23 04:10:51 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 23 04:10:51 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 23 04:10:51 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 23 04:10:51 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 23 04:10:51 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 23 04:10:51 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 23 04:10:51 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 23 04:10:51 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 23 04:10:51 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 23 04:10:51 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 23 04:10:51 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 23 04:10:51 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4205fb36-0df5-4c11-b468-89f59d97352c could not be found. Apr 23 04:10:51 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi Apr 23 04:10:51 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 23 04:10:51 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi Apr 23 04:10:51 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 23 04:10:51 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 23 04:10:51 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 23 04:10:51 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 23 04:10:51 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 23 04:10:51 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4205fb36-0df5-4c11-b468-89f59d97352c could not be found. Apr 23 04:10:51 user devstack@n-api.service[61308]: ERROR nova.api.openstack.wsgi Apr 23 04:10:51 user devstack@n-api.service[61308]: DEBUG nova.api.openstack.wsgi [None req-825c6d8f-85a4-4c59-880f-d9b2fffc41a4 tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] Returning 404 to user: Instance 4205fb36-0df5-4c11-b468-89f59d97352c could not be found. {{(pid=61308) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 23 04:10:51 user devstack@n-api.service[61308]: INFO nova.api.openstack.requestlog [None req-825c6d8f-85a4-4c59-880f-d9b2fffc41a4 tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/4205fb36-0df5-4c11-b468-89f59d97352c" status: 404 len: 111 microversion: 2.20 time: 0.030026 Apr 23 04:10:51 user devstack@n-api.service[61308]: [pid: 61308|app: 0|req: 154/458] 10.0.0.210 () {64 vars in 1357 bytes} [Sun Apr 23 04:10:51 2023] DELETE /compute/v2.1/servers/4205fb36-0df5-4c11-b468-89f59d97352c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 23 04:10:51 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi [None req-d6bc25d1-db41-4cd0-b015-4bb14d2826a4 tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] Calling method '>' {{(pid=61306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 23 04:10:51 user devstack@n-api.service[61306]: DEBUG nova.compute.api [None req-d6bc25d1-db41-4cd0-b015-4bb14d2826a4 tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] [instance: 4205fb36-0df5-4c11-b468-89f59d97352c] Fetching instance by UUID {{(pid=61306) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 23 04:10:51 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-d6bc25d1-db41-4cd0-b015-4bb14d2826a4 tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 04:10:51 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-d6bc25d1-db41-4cd0-b015-4bb14d2826a4 tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 04:10:51 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-d6bc25d1-db41-4cd0-b015-4bb14d2826a4 tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 04:10:51 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-d6bc25d1-db41-4cd0-b015-4bb14d2826a4 tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] Acquiring lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 23 04:10:51 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-d6bc25d1-db41-4cd0-b015-4bb14d2826a4 tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 23 04:10:51 user devstack@n-api.service[61306]: DEBUG oslo_concurrency.lockutils [None req-d6bc25d1-db41-4cd0-b015-4bb14d2826a4 tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] Lock "d6e736f5-47e7-43b0-b79c-ca5bf29d7fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61306) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 23 04:10:51 user devstack@n-api.service[61306]: INFO nova.api.openstack.wsgi [None req-d6bc25d1-db41-4cd0-b015-4bb14d2826a4 tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] HTTP exception thrown: Instance 4205fb36-0df5-4c11-b468-89f59d97352c could not be found. Apr 23 04:10:51 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi [None req-d6bc25d1-db41-4cd0-b015-4bb14d2826a4 tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] Request method failure captured: Apr 23 04:10:51 user devstack@n-api.service[61306]: request: GET /compute/v2.1/servers/4205fb36-0df5-4c11-b468-89f59d97352c HTTP/1.1 Apr 23 04:10:51 user devstack@n-api.service[61306]: Accept: application/json Apr 23 04:10:51 user devstack@n-api.service[61306]: Accept-Encoding: identity Apr 23 04:10:51 user devstack@n-api.service[61306]: Connection: close Apr 23 04:10:51 user devstack@n-api.service[61306]: Content-Length: 0 Apr 23 04:10:51 user devstack@n-api.service[61306]: Content-Type: application/json Apr 23 04:10:51 user devstack@n-api.service[61306]: Host: 10.0.0.210 Apr 23 04:10:51 user devstack@n-api.service[61306]: Openstack-System-Scope: None Apr 23 04:10:51 user devstack@n-api.service[61306]: User-Agent: python-urllib3/1.26.15 Apr 23 04:10:51 user devstack@n-api.service[61306]: X-Auth-Token: gAAAAABkRK57iHgBWhBr7oDpNVFk09r9LkBMLJJvLUDSAB35CE4DR6LQUcoSG_MgoXOReh7P7cRjjTvhSXqG3zBWun0b0IiY3L6kl45ZnSEItShYRvU-Vju8srqNOxIHR6NgMoApmgrMt7TjIq1s8-6piWDQTSwCsUa-UWl-mg7ZtxilZiL_w1U Apr 23 04:10:51 user devstack@n-api.service[61306]: X-Domain-Id: None Apr 23 04:10:51 user devstack@n-api.service[61306]: X-Domain-Name: None Apr 23 04:10:51 user devstack@n-api.service[61306]: X-Identity-Status: Confirmed Apr 23 04:10:51 user devstack@n-api.service[61306]: X-Is-Admin-Project: True Apr 23 04:10:51 user devstack@n-api.service[61306]: X-Openstack-Nova-Api-Version: 2.20 Apr 23 04:10:51 user devstack@n-api.service[61306]: X-Project-Domain-Id: default Apr 23 04:10:51 user devstack@n-api.service[61306]: X-Project-Domain-Name: Default Apr 23 04:10:51 user devstack@n-api.service[61306]: X-Project-Id: 7d84d2e6776c4ac38b90b752a36600c3 Apr 23 04:10:51 user devstack@n-api.service[61306]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1622749322 Apr 23 04:10:51 user devstack@n-api.service[61306]: X-Role: reader,member Apr 23 04:10:51 user devstack@n-api.service[61306]: X-Roles: reader,member Apr 23 04:10:51 user devstack@n-api.service[61306]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7d84d2e6776c4ac38b90b752a36600c3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7d84d2e6776c4ac38b90b752a36600c3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/7d84d2e6776c4ac38b90b752a36600c3"}]}] Apr 23 04:10:51 user devstack@n-api.service[61306]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1622749322 Apr 23 04:10:51 user devstack@n-api.service[61306]: X-Tenant-Id: 7d84d2e6776c4ac38b90b752a36600c3 Apr 23 04:10:51 user devstack@n-api.service[61306]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1622749322 Apr 23 04:10:51 user devstack@n-api.service[61306]: X-User: tempest-AttachVolumeShelveTestJSON-1622749322-project-member Apr 23 04:10:51 user devstack@n-api.service[61306]: X-User-Domain-Id: default Apr 23 04:10:51 user devstack@n-api.service[61306]: X-User-Domain-Name: Default Apr 23 04:10:51 user devstack@n-api.service[61306]: X-User-Id: 929f88dec4234641a37fdda799108cf2 Apr 23 04:10:51 user devstack@n-api.service[61306]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1622749322-project-member Apr 23 04:10:51 user devstack@n-api.service[61306]: method: > Apr 23 04:10:51 user devstack@n-api.service[61306]: exception: Instance 4205fb36-0df5-4c11-b468-89f59d97352c could not be found. Apr 23 04:10:51 user devstack@n-api.service[61306]: action_args: {'id': '4205fb36-0df5-4c11-b468-89f59d97352c'} Apr 23 04:10:51 user devstack@n-api.service[61306]: {{(pid=61306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 23 04:10:51 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 23 04:10:51 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 23 04:10:51 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 23 04:10:51 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 23 04:10:51 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 23 04:10:51 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 23 04:10:51 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 23 04:10:51 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 23 04:10:51 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 23 04:10:51 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4205fb36-0df5-4c11-b468-89f59d97352c could not be found. Apr 23 04:10:51 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi Apr 23 04:10:51 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 23 04:10:51 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi Apr 23 04:10:51 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 23 04:10:51 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 23 04:10:51 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 23 04:10:51 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 23 04:10:51 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 23 04:10:51 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 23 04:10:51 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 23 04:10:51 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 23 04:10:51 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 23 04:10:51 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 23 04:10:51 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 23 04:10:51 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 23 04:10:51 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 23 04:10:51 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4205fb36-0df5-4c11-b468-89f59d97352c could not be found. Apr 23 04:10:51 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi Apr 23 04:10:51 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 23 04:10:51 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi Apr 23 04:10:51 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 23 04:10:51 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 23 04:10:51 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 23 04:10:51 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 23 04:10:51 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 23 04:10:51 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4205fb36-0df5-4c11-b468-89f59d97352c could not be found. Apr 23 04:10:51 user devstack@n-api.service[61306]: ERROR nova.api.openstack.wsgi Apr 23 04:10:51 user devstack@n-api.service[61306]: DEBUG nova.api.openstack.wsgi [None req-d6bc25d1-db41-4cd0-b015-4bb14d2826a4 tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] Returning 404 to user: Instance 4205fb36-0df5-4c11-b468-89f59d97352c could not be found. {{(pid=61306) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 23 04:10:51 user devstack@n-api.service[61306]: INFO nova.api.openstack.requestlog [None req-d6bc25d1-db41-4cd0-b015-4bb14d2826a4 tempest-AttachVolumeShelveTestJSON-1622749322 tempest-AttachVolumeShelveTestJSON-1622749322-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4205fb36-0df5-4c11-b468-89f59d97352c" status: 404 len: 111 microversion: 2.20 time: 0.027637 Apr 23 04:10:51 user devstack@n-api.service[61306]: [pid: 61306|app: 0|req: 152/459] 10.0.0.210 () {64 vars in 1354 bytes} [Sun Apr 23 04:10:51 2023] GET /compute/v2.1/servers/4205fb36-0df5-4c11-b468-89f59d97352c => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0)